DOCUMENT RESUME 



ED 228^225 ... 

AUTHOR 
TITLE 

PUB DATE 
NOTE w 



# PUB TYPE 



EDRS PRICE 
DESCRIPTORS 



< SP 022 111 

Spiilman, Russell J.; And Qthers 

A System for Assessing and Documenting the Experience 
of Pre/Inservice Teachers., 1983 Update. 
Ohio *tate Univ. , Columbus. Coll. of Education. 

Feb 83 . ' ' 

102p.; Paper presented at the Annual Meeting of the^ 
American Association of Colleges for Teacher 1 
Education (Detroit, MI, February 22-25 f 1983). . 
Speeches/Conference Papers (150) — Reports - 
'Descriptive (141) — Collected Works - General (020) 

MFQ1/PC05 Plus Postage. 

Data Collection; *Educational Assessment; Evaluation 
Needs; Higher Education; Mnformation Systems; 
Inservice Teacher Education; Preservice Teacher 
Education; *Program Evaluation; Program 
Implementation; Program Improvement; *Student * 
Evaluation; *Teacher Educatioa-^rograms ; Teaching 
Experience • 
IDENTIFIERS *Student Information System 

ABSTRACT . * *' 

A panel discussion was held on the Student 
Information System (SIS) established at Ohio, State University. The 
SIS was designed to: (1) document student experiences; (2) v diagnose 
student progress in programs in. order to fuLfill general student 
advising and counseling functions; (3) collect data on students and 
programs for evaluation purpose^; and * (4) research the nature of 
teacher education and development and other professional personnel 
programs. Panel presentations included: (1) "Overview: A System for 
Documenting and Assessing the Experience of Pr^/Inservice Teachers" 
(Russell J. Spillman); (2) "The History, Purposes, and 
Conceptualization of the Student Information System" (Nancy* L« 
Zimpher); (3) " Implementation of the ^Student Informatipn System" 
(Wiliiam E. Loadman);. (4) "A Focused Evaluation of the Student 
Information System" (Ann L. Schreck); (5) "Improvement and Use of the 
Student Information System Teacher Candidate Profile Instrument" 
(Penelope A. ^ Reighart, Zelda J. Holcomb); (6)" 'What They Bring with 
Them' — Formative Dimensions of the Student Information, System" (Peter 
S. Lemish); and (7) "Peering into the Future of the Student 
Information System" (William E. Loadman). (JD) 




f 



********************************************** 

* Reproductions supplied by EDRS are the best that can be made * 

* from the original document. * 
************************************************************* * ********* 



ERLC 



< m 



f\J 

CM 
CO 

ca 



A SYSTEM FOR ASSESSING AND DOCUMENTING , 

THE EXPERIENCE 
OF 

PRE/INSERVICE TEACHERS 



"PERMISSION TO REPRODUCE THIS 
MATERIAL HAS BEEN GRANTED BY 



v 



• 1983 UPDATE 



COLLEGE OF EDUCATION 
THE OHIO STATE UNIVERSITY 



TO THE EDUCATIONAL RESOURCES 
INFORMATION CENTER (ERIC)." 



/ U.S. DEPARTMENT OF EDUCATION 

*mTr T i™ AL ,NST,TUTE ° F ED UCATIO N 
^^MCATIONAL RESOURCES INFORMATION 
/ CENTER (ERIC) , 

V Th.s document has bee* reduced al 
'•ceived from the person or organ izat.on 
originating it 

Minor changes have been made to .mprove 
reproduction quality. 

• Points of view or opinions stated in this doCu" 
ment do not necessarily represent official NIE 
position or policy. 



A panel presentation at the annual meeting of the American Association 
of Col-leges for Teacher Education, Detroit, February 1983. 



ft 
% 



V 
ERJC 



( 




CONTENTS 



I. Overview^ A System for Documenting and Assessing 
the Expedience of Pre/Inservice Teachers 



Russell J- Spillman 



.11. The History, PuYposes* and Conceptualization of 
the Student* Information System 



III. Implementation of the Student Information System 



Nancy L. Zimphejr 
William E. Loadman 



IV, A Focused Evaluation of the. Student Information 
System * 



Ann L. Schreck 



V. Improvement and Use of the Student Information 
System Teacher Candidate Profile Instrument 

VI. "Whjt They Briqg With Them" - Formative 

Dimensions of the Student Information System 

VII. Peering into the Future of the Student 
j Information System 



Penelope A. Reighart 
Zelda J. HoTcomb 

.< ' 

\ 

Peter S. Lemish 



William E. Loadman 



APPENDIXES 

A. 'Names and Addresses of Panel Presenters and Reactors . 

B/ Freshman Early Experiencing Program Exploration Profile 
• (FE£P Version of the TCP Instrument) 

C. Professional Introduction Teacher Candidate Profile 



D. Critical Event Form 



r 



I. A SYSTEM FOR DOCUMENTING AND ASSESSING 
THE EXPERIENCE OF 'PRE/INSERVICE TEACHERS 



An Overview 

Russell J. Spill man 
Acting Dean 
College of. Education 
The Ohio State University 
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Within the .last three years, the College of Education at The Ohio State ^ 
University has j)een working on the creation and implementation of a system for 
documenting and assessing the experiences and abilities of its -teacher 
candidates, toward the improvemen\ s of its teacher education programs. 
Initially we created this, system because we were dissatisfied with what has 
become tfie accepted me^iris of program evaluation in* teacher education; \that is, 
through follow-up studies/ While we will address tha limitations of <fo\low-up 
studies later in tKis presentation^ our general criticism of this single 
vehicle, for program evaluation is that the results of follow-up studies do not 
provide conclusive information on which to base continued development and 
improvement of -teacher education* programs. Further, their summative* nature 
does not provide the kind of formative information necessary for an effective 
and responsive teacher education program. . \ 

Our. view of program development and improvement requires that developers 
engage in the ingoing process of "developmental inquiry 11 (Sanders, 1981), 
which provides Tor the generation of hypoCbeses through ^a/data collection 
process that informs further development of programs. Developmental inquiry 
requires a documentation and assessment system that can p^povide a rich 
contextual accounting of both teacher candidates and programs. Our intent is 
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first to determine what" is happening in our programs concurrent with determining 
what should happen. . With this perspective in mjnd we' have 'designed ,the— 
assessment and documentation system inferred to herein as the Student 
Information System X$IS). - ^ , - . 

, a ' 

t 

At this time our efforts continue to focus on implementation at the * 
program ^area level and. in those courses (or experiences) Jthat are common for 
all of our teacher candidates. Instrumentation has been developed, pijoted 
and refined for several of these general professional experiences, and in 
several of the program areas. » 

The purpose of this presentation is to review the purposes, theoretical 

framework and component parts of t^rte system; to explicate data results from 

•certain of the instruments that /have been piloted and revised and one of the 

Qualitative data collection efforts; to summarize the issues related tcv the 
• ■ > * , . / - ' > 

.totality of the implementation process; and ttf present issues associated with 

the near and long-term futufe of SIS. These presentations will ther^be 

critiqued and discussed byjoutside evaluators presenting on this panel. 

SIS Jias four basiq ? , purposes/ They are: ■ * 

- 1. to document student eperien^e for>ccountabil ity purposes; 

2. to diagnose Vtude^nt prWjpeis in programs in- order to fulfill general 
student Advising andT counseling functfo^S* 

3. ^'\o collect data abou\jDi/r students and programs for purposes of 

a evaluat/on of both graduates 'and programs, toward program 

% ' * 

improvements, and; 

4. ' to research the nature of teacher education arid teacher development 

■ v i I - % - * ■ • 

/ And' other professional personnel programs. 
In order to achieve^hese purposes we have designed a system that may be 
described/ brfe.fly, as followsV SIS is multi-dimensional , including the m 
collection of data at multiple points in the professional education program 

' ■' r : • 7 . • . ■ 



using multiple 'data co^ection vehicles. The cteta will be collected at various 
"levels" as follows: basic demographic data about students and programs; 
academic data such as transcript information and entry test scores; performance 
data as collected through qualitative and quantitative, measures , including 
standardized measures; and sel f-report&d data and data collected in various 
campus and field settings, through ethnographic techniques. Data collection 
will cfommence a,s the student enters the university and continue throughout the 
early years of the graduate's employment. Participants 'in this system wil*^ 
include students, faculty members, cooperating teachers in field sites and 
academic and career "counselors. m ^ 

We have been involved in tjie development of the, conceptual bases and the 
design of the system for documenting and assessing teacher candidates and 
programs for three years. A year ago, we hosted a national conference on#the 
^improvement ot teacher education programs. 1 At that tiftm * we* prese/ited this 
system to both a pre-conference of selected crit,ics^as well as to. the general 
conference participants for their review and comments. Last year we also were 
involved in negotiating the possible use of SIS with various program areas in 
the^ Col lege.. This '.process continues to involve our introducing the system, 
negotiating its use, and refining the, system on the basis of program directors' 
comments and experience using the system. . 
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II. The History, Purposes a^^nceptua/izatiah of the 
Student Information System 



Nancy' L. Zimpher! . 
Coordinator, Program DeVelppment 
College of Education; 
The Ohio State UniYersity 
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The purpose of this presentati<jp is four-fjQjd: 1) to prejent^lTfft story 
and context for the development of SIS; 2) to. v^Pati a set of assumpl^ns and 
\ cdnceptuafization about pro^HJ^^velopment |hat support and explain "the ^ % 
purposes of . the system; 3) to explicate .the purposes of tlte system; andtffr) to 
describe the component parts (or , *ata : matri>c)^f «SIS. 

History and Context ^ • v •'■ :: J • \ t 

Like most issues that evolve fn, a college pf education^the crjeatioh df 
the Student Information System has ^een stimulated by events and forces both 
external and internal to the OSU Co\lega .of Education.^ There is an increasing 
public demand for an improved educational system. A significant portion of # 



this demand is for moire highly qualifi 



ed teachers ( Time Magazine , "Help! 



Teachers Can't Teach 11 ). State legislitufrfes are responding to these public, 

' r — - ^ ' 

pressures by mandating new standards for teacher education (e.g., State 
standards for Teacher Education in OtjicK 1975), including responsibility to 
develop and implement eva1uation--acdounUbinity procedures. Currently, more 
and more school districts are requirjrfg that ^teachers demonstrate their , 
competencies through some sort of test, e>.g, , the National Teacher Examina- 



tion. Yet the solution to determini 



ng effective teaching seems to require a 



mo 



re thoughtftfl approach. Rather than accede to the pressures^ reflected in 



the current agendas of various publi 



at The Ohio State University is undertaking a major research and development 



effort that attempt^ to temper publ 



c interest groups, the College of Education 



c demand with i*s knowledge of recent • 
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Vesearch and developments in this area, matching thes^erff^rts withVhe mission 
- ■ * * 

:f and assumptions inherent* in this College^. 

"We will parallel external forces described above with some events of the 

last decade . i n the tnstory of our College. In keeping with national movements 

to, install efforts to evaluate ieacher candidates after graduation, the College 

created a follow-up system, -beginning in 1976. This system is now in full 

operation, including quantitative evaluation and on-site observations .of 

graduates 1 during the first and> third years of practice. Even with' this effort, 

however, we have often asked ourselves, n so what, 11 after the timeconsuming 

research has, been finished. Katz et al. (1981) have illuminated this a'rea by ^ 

pinpointing, the* persistent problems 'of follow-up studies that wi\ll never ^ 

* * ■,'•* 
vanish— difficulties ip active faculty involvement in'program change, ,\. . 

"difficulties* in interpretation due to the feed-forward issue. Qur "so -.what" ^ 

feeding, however, is prompted by a'larger set of issues., It is tt^ese issi^s .* 

* which have prompted us to begin dismantling our current follow-up system and ♦ 

^ repTace.it with a more conceptually valid and reliable system for the » * 

* • .* ' *- . **■ ' * • 
5 evaluation and development of programs - here at OSSj. Lt is these Issues to 

which we now turn. \ 
- ■ ' ■ ' - * V 

Existing designs for the conduct of fol Tow-up studies have apparently s 

been' built on a set of assumptions as follows: , * 

'■■ q v • - v . ■ . * , ' " ' I 

1. Whatever skills a "teacher exhibits arise as a result of his/her 



.teacher training. t £ . 
2.*' \lt is possible to assess, a teacher 1 s. competence withoCit baseline 
"* data: that is, without knowing anything; at all about the teacher V 

. A' v ■ • • 

preservig^ experiences. \ 
3/ It sis possible/to assess a teacher's competence based upon teacher, 
self repofct'and a short omnibus post-graduation observation of the 
teacher at work (Green and Stone, 1977). . , 



According to thi most recent evidence available (Medley, 1977), one of 
:he mbst serious conceptual problemsMs that the. design does not provide a , 
lirvk between knowletfhe, skills, attitudes; GY values (&S. A.V. 1 sO leatneci 
'during the training Experience. and tliose same ICS. A. V. 1 s wjiich are tapped 
after the graduate cjompletes jjis or hfr schooling. That is/ if there is an. 



impact "to the training experience {Am if thesis riot, then we are all in 
serious trouble), then a design ^^uid permit a theoretical . link -between -v 



presfervice skills 



candidates contin 
wi 



nd_ inservice performance to b£ proven.^. 

- : * » • 

In addition tci the absence of a strong feedback lqop for foil ow;up studio, 

there are other internal issues y/hich troupe ^program developers.^ Teacher 



e to arrive at the culminating experience, student teaching, 



th undiagnosed and unremediated problems. Ethnographic studies conducted by 
deVoss, 2impher, and Noth (1978) during student teaching revearKthat students 
have strengths anqt weaknesses that appear unrelated to the preceding' course 
experiences. Intensive studies of firsts/ear teadhers suggest that graduates 
of this and other teacher trainiag programs continue" to experience great 
frustrations in classroom management,, and other problems of teaching and 
learning. FollowJ-up studies itemize a long list of skills beginning teachers 
say tfiey never acquired in 'their program. Paradoxically, these skills an* 
documented components of existing course requirements. All these issues 
suggest that survival techniques for begin^fng teachers ^ontinue to be self- 
acquired and not attributable to preparation programs^ > , 

Although each of these forces; internal and external, appears tqj^present 
isolated strands i nT the * hi story of bur program, their confluence results When , 
attempting' to measure the cfl wmce of our graduates compared to teacher 
candidates nationally, or in light of the apparent needs and frustrations of * 
first year teachers. It i's out of this bed of anomalies that the College of 



Education Student Information SystgrT has evolved, hot out of any single event f 
but out of a study of multiple causes and needs for the obvious improvement pf 
„ teacher candidates and teacher education programs. 

.4 * 

Conceptual Framework 

I * * * ' 

The .alternative approach which we have proposed for'the evaluation and 

i - « » * * - * * k 

development of teefcher education students and programs focuses upon the ^ \ 
fol 1-owing general questions: Jn what ways do teachers develop during the(^\\ 
period of thfcir participation in a particular teacher education program? Are 
ouf teacher-graduates qualified professional educators? ,How does this program 
facilitate their development? T<^ answer these questio^we have implemented 
an approach which Is based upon ;fundamen^il ly different' understandings of, ' , 
first, ,the relationship between teacher education students ahd programs^ and, 
secorfdV the Vole and process of evaluation and development in teacher education 
programs. 

There 8s a complex, interactive relationship between students and programs, 
As they develop, both are independent ye\Jt they are mutually constitutive and 
reflexive ^f one another. The following diagram illustrates this interactive 

view of the student-jiragram relationship: # : * > 

* » ' " . PROGRAM . 

* * FftShman > Professional Special ^ Student^ Teaching 

Early introduction Methods Teaching Appointment 

Experience - 



At - Point l ,<*the teacher candidate enters the program with prerestabl ished. 
formative knowledge, skills, attitudes, arid values as well as perceptions 
about seVf and t self as tocher/ As the teacher candidate moves through the 
program, along the bottom wave in •the^di^gram, the. personal .and professional 
development that t^kes place is- a refining extension .or addition to t^hese 
dimension^ of a teacher candidate's life. • - o . ' 

At Poirrt ,2 , the program, like the teacher candidate, *is recognized to be 
a developing entity. A This^ is noted in the diagram as the top waVe. The 
program' s' history accounts' in good part for the expectations and content 
represented in the instructional activities facilitated later by the college 
instructor. " \ 

\ * 
v At Paint 3 , the program and candidate first meet. Hopefully, our 
programs include 'and are affected by the entry characteristics of our teacher 
candidates. Of particular importance is knowledge of formative dimensions, or 
the teacher candidate's knowledge, skiVls, attitudes', and values prior to 
his/her entering the program. ^ \ 

.At Point 4 , shown as a broken,, tine, dynamic form$ of interaction take 
place as the student's learning experiences evolvevin the program (n.b~ a 
three dimensional, diagram would shpw the two waye lines ancj^ the^ interaction ^ 
zone oscillating). 'The interrelationship of the teacher candidate and the 
pVogram is. dynamic and constantly in flux. The degree ^ confluence depends 
to a significant degree upon such variables as the teacher candidate, the 

* instructor, the activities as designed, implemented, and experienced, the 
context, and the nature of interaction. Much of : this interaction," in tite form 
of activities and teacher^sandidate performance, is observable. Here a^ 
three-way analysis by, for ^x^jnpTe , th? teacher, candidate, the college 
instructor;, and the cooperatul^fe^cher , should provide us with a 
multidimensional, view of the ex^ience^ This is reflected in the diagram in 
the outer rectangle. In' additiorft^^ much. of the impact of this 

' experience is "private" and may ^^|fbl rggWed through reflective,- narrative 
accounts and analysis. The a ^ajp^e di|||^m outside the-outer rectangle 
represents this "private" *zone 

At Point 5 , the candidate and ^^p^ proceed together in the 
professional preparation sequence. fjAs experiences in the orogfam impact upon 
the teactier candidal in various ways l and vjce versa, they become ^the 
formative dimensions for the teacher candidate and the program. It is through 
this process that growth* and development take place for both students and the 
program. ~ v - - # 

Existing models of teacher education explicate program content and/*? 
evaluate teacher-graduates in terms of predetermined, pbservable, and 

"measurable" skills, competencies, or objectives. This approach is \ 

i j > 

represented within the inner rectangle in the above diagram. However, the 



complex, interactive nature of the student and program development process 



requires a* more inclusive^rjii of analysis, one capable of documenting the* 
ongoing" nature and-^he 'complexity 4f the professional preparation experience. 

Thus, £he areafor documentation is located both within^and outside the outar* 

\ ' ■ \" ' ' .. ~ * 

rectangle in the above diagram. * - ■ 

• > % ** " & 

In our view,' evaluation should result in a series of interpretive ft 
judgments made by faculty members ^bout t|ie appropriateness and value of 
students 1 experience and learnings. Viewed in this manner, evaluation has a 
critical role in the program improvement pi^cess. Indeed, these judgments 
have a formative role - since they sjiould assist faculty members in determining 
whether alterations are needed to strengthen the program.. However, in order 
to make informed judgments, faculty members must have access to a rich data 
source. Therefore, a comprehensive documentation system is required; one^-"' 



capable of capturirrcF the complex nature of both student artdV^g^ am develop- 
ment. Thus, evaluation is the critical, intermediary link in moving from data 
- to proposals for prog^mmatic improvement. 

' ^The alternative approach to program evaluation and development which we 

are implementing at The Ohio State University uses as its theoretical . bases 

* v*. . . , 

the analyses outlined above and the practicentric-developmental f orro of inquiry 



proposed by Bronf enbrenri^r (1979) ,' Dunn%(1971) , and Sanders (1981): This 

approach consists of three general components: 

■ ■ * 

1) Documentation . The < fathering apd; analysis of data on students and 
^and programs. 

2) Evaluation . * Interpretive judgments made by faculty members on the 
appropriateness and value of students! experiences and, learnings. 

3) Program Adaptation . Proposal, selection, and implementation of 
changes in the program By the faculty. . \ , 



The documentation component performs the esseptial function of providing 
faculty members with the data necessary for them to engage in the program 
improvement process. Givan this important role, as well as its comprehensive 
.approach to the study of teacher candidates and graduates^ we feel that it 
9 merits more detailed elaboration. 

SIS rests upon the following design principles /which, wh^n examined in 
the context of its theoretical bases, purpqses,; and the expectations placed ^ . 
upon it, give rl a unique structure. 

1. The system must stress description as well as assessment . It is 
crucial that a student's experiences be documented (i.e., described) 

v , ' ' and assessed before any evaluations are made about his/her profes- 

sional qualification* * * 

2. SIS must include both multiple forms of and triangulated views of 
data inputs and analyses. * • 

3. SIS must provide, as its primary source, data related to the t&acher- 
candidate's actual experiences/performances, juxtaposed to a 
description of what was supposed to happen. 

4. SIS must contain both formative and summative elements. Positive 
..change in either student on program must result from frequent 

diagnostic assessments. The aim of SIS is to facilitate change by 
providing a rich source of "data and analysis, rather than produce 
results from single, judgmental, all-or-none evalautions. 

5. SIS must provide for sequential , cumulative , and longitudinal data 
collection, analysis, and usage. Thus, information gathered through 
SIS at "time A" will hopefully influence at "time B" by tempering 
and clarifying the student or program profile. 
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6. SIS must have cross-group validity. 

7. SIS must stress simplicity and manageability. Its findings must be 
t understandable and interpretable by college instructors^ publ ic 

school teachers, teacher candidates, counselors, and legislators. 

8. * SIS must provide for maximum student input. 

9. SIS must be held to be legally responsible. Its design and usage 

i ' .. . '• " " 

should insure that our students receive clear direction on their 

right to participate in\he system, feedback on the handling and 

■ *» 

processing of the data, and knowledge of the final 'disposition of 
the findings. • * . " . 

System Purposes ? \ 

SIS has the following four basic purposes: 

T. To collect data about our students and programs for use in the 

evaluation of both graduates cind programs; 
2. ' * To provide data for use in student advising, counseling, and 
remediation; v 
. v 3, To provide a data source for research on the nature and the develop- 
ment of teacher education students and programs as well as other 
professional education personnel programs; 
4. .' To document student experiences for accountability and accreditation 
purposes. 
System Description 

SIS assumes a mul ti-'dimensional , cumulative view of the data to be 
collected. The collection of data takes place at muHVple % points in the 
professional education program using multiple data collection vehicles. 
Participants/data sources in this system include students, faculty members, 
cooperating teachers in field sites as well as academic and career counselors. 
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The data ,will be collected at various "levels" as fol'lows: basic demographic 
data about students and program; academic data such as transcript information 
and test scores; performance data as collected through qualitative and quanti- 
tative measures, including standardized measures; self-reported data; data 
collected in various campus and field settings through ethnographic techniques; 
and program history and development data. I 

This system requires the entry of data at various points in the. teacher 
education program, from admission to the university, through the first years 
of the candidate's teaching position-. These points are referred to as the 
"Profile Progression." There are four component areas and each data" entry 
point is explicated by/certain types of data described below and is illustrated 
in the attached Data Matrix. 

The data included in Component I (Descriptors) of SIS are at the most 
quantitative and descriptive- level . This component presents data, typical ly 
recorded on official student transcripts; a record of the student's field and 
clinical experiences, to include the number of contact hours in field and 
clinical settings; a demographic curricular description of field sites 
(urban/suburban, open-spaced/traditional, mastery learning/informal education, 
V^c); career decision data; and^psychoiogical data. ^ • 

- Other data included in Component I might be the student's test history, 
from early administration of ACT/SAT tests, to university math and English 
placement tests, end College administration of the National Teacher Examina- 
tion or another standardized test. Particularly in regard to the display of 
standardized test scores, such records will always be displayed in l"ht of 

other academic measures, such as grades and class standing, and also in rela- 

- <5 

tion to more triangulated and qualitative data .generated in Components II, 
III, and IV described. below. In summary, Component I includes demographic, 
achievement, experience, career decision, and psychological data. 
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Component II (Assessment) contains all the assessment instruments. * They 
are designed to give a longitudinal picture of selected performance capabilities 
for each teacher candidate. That is, ^certain kinds of questions are asked at 
the freshman, sophomore, junior, senior and postgraduate level in order to 
determine when a student acquired a certain skill. All assessments are gathered 
thrpugh the following method: only situations where at least three persons 
can assess a performance are used; further, only persons who are intimately 
associated with the teacher candidate completeifan assessment. Finally, all 

the completed assessments are triangulated after assessment. The interested 

-.1 

parties gather together to discuss tjar^ir ratings. Ratings are not changed as 
a result of this iconference, but rather the outcome of the conference is ' 
documented for inclusion in the system's Component III. 'Thus, although each 
instrument looks simplistic, the accumulation of sets of judgments over a 
teacher candidate's career will give an accurate picture of his/her perfor- 
mance. 

Component III (Narrative) consists of descriptive and analytical materials 
written by the teacher candidate, the adviser, college instructors/supervisors, 
and cooperating teachers. These data will, be gathered at appropriate points 
throughout the teacher candidate's participation in the program. These 
narrative materials complement the data available in -Components I and II. As. 
descriptive, analytical and reflective accounts, these materials should be a 
rich source of information about the nature of the teacher candidate's experi- 
encej? and developing pedagogical style. 

In Component IV (Context) , teacher candidates' experiences and develop- 
ment are to be interpreted with due consideration given to the experiential - 
environment. Therefore, as part of the assessment procedure, teacher candi- $ 
dates, college instructors, and cooperating teachers and others involved with 
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teacher candidates provide descriptive state/nents about the context in which 
the experience takes place. The "experiential, environment" : includes 
information about the settings in which the teacher education program occurs, 
both on campus and in the "laboratory" of r local schools and agencies used as 
field sites. ... 

The data accumulated as a result of this documenting system will be . 
assembled into portraits or profiles of the students, individually or as a 
sample, and the program. . Multiple forms of qual itative and quantitative 
techniques for analysis of these data will be utilized. Analysis and 
presentation of finding will be directly related to the purposes for producing 
the analysis (i.e., use for program evaluation is significantly different from 
use for student advisement or for accreditation documentation). 
Summary * ■ • 

A description of SIS would not' be complete without ayi explanation of the 
process and issues related to the implementation of the system. Also, we 
offer in this presentation specific data gathering efforts, along with aA 
analysis of those measures and their subsequent revision. Illustrations will 
be offered for Components II and III of the system. We will conclude by 
reflecting op the future of SIS at our institution and its contribution to the 
national effort to improve teacher preparation. 
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DATA MATRIX 

STUDENT INFORMATION SYSTEH 
Cdllege of Education 
The Ohio Statfe University 



PROFILE PROGRESSION 



COMPONENTS 



Pre z 1 
PrQfessioBii 
Data 



Descriptors 

(factual descriptions In- 
cluding demographic, achieve- 
ment, experience, career 
decision and psychological 
data) 



Demographic data from 
Education Student Data Base 



II. Assessment 

(multiple perspective 
judgment by expressed 
criteria Of the exper- 
ience) * 



High School Percentile 
ACT Composite Score 
GPA Major Study 
GPA Cumulative U«) 
NTE Commons Percentile 
NTE Area Exam Percentile 
NTE Composite Percentile. 

Ar»H»«1r trwrrint McT 



III. Narrative 

(multiple perspective 
commentary and analysis 
of experiences) 



IV. Context 

(descriptions which 
will assist user In 
Interpreting environ- 
ment of experiences) 



Profess ional 
P reparation 



FEEP 



i./ 

. Education 
* 450/451 



Special 
Methods 



Foundations 



Content 
Special ty 

Courses 



Student 
Teaching 



Post 

Graduation 
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Career Development (2) 

Checklist 
Commitment Sheets (3) 

(Pre and Post) 
Dlolnventory 14} 
Hyers-Brlggs (5) 
PRF 

Course Description 
Field Placement 



♦Exploration Profile (TCP) (6) 

tAcaderalc Assessment 

Checklist 
Mid quarter evaluation (7) 
End quarter evaluation (8) 



tPersonal Growth 
Plan 

Experience Report (9) 
Form (ERF) 



L. 



Course Description 
Field Placement^ 



Teacher Candidate Profile 
(TCP) (10) 



CrltlcaT Event (11) 
Forms 

Conference Report (12) 
Formsv 



Course Description 
Field Placement 



TCP's In P.E. 
TCP's 1n E ft MC 
TCP's In Excep. 



♦Critical Event 
Forms In P.E. 



Course Description 
Field Placement 



Course Description 
Field Placement 



Field Placement 



TCP's In P.E. (13) 
TCP's In E ft MC 
TCP's In Excep (13) 



Follow-Up (14) 

Demographics 
Follow-Up Teacher (15) 

Observation Form 
Teacher Interview (16) 

Form 



f 



* Currently being modified 

t Beiiuj created. 
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HI. implementation of the Student Information System 

William E. Loadman . 
Coordinator, Measurement and Evaluation Services • . 

Collage of Educatioft 
x The Ohio State University 

Introduction , 

The student information system (SIS) at The Ohio 'State University ' s 
College of Education has been formulated over the past three years. During 
that time efforts have been initiated to implement various pieces of the 
system. This paper will: a) identify what the current literature suggests 
about implementation of such a system; b) describe what has been done to date 
with this system; and c) attempt to examine issues, concerns and status of the ^ 
implementation.^ » . ' . 

When one searches the literature for information regarding the implemen- 
tation of an evaluation system, several important conclusions can be drawn ■ 
rather rapidly.** First, the literature is replete with discussions regarding 
the implementation process. However, there is limited empirical research V , 
, conducted on the process. The second major finding in the litefraturg is that 
the discussions on implementation tend to fall iQto^ two broad-categories. The 
first category can be characterized as methodological or technical concerns. 
.There are Extensive discussions on topics such as sampling, variable selection, 
instrument construction, evaluation designs, data analyses, etc. The second 
categoYy.can be characterized as interpersonal or interactional concerns. 
Here the, literature is surprisingly devoid of information except for an 
occasional admonishment that the evaluator needs to be aware of contextual 
circumstances or local political situations. There are source* which . 
selectively identify important elements which fall under the interpersonal 
dimension. Some of these elements would include such things as securing 
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administrative support, identifying and interacting with key actors, broad- 
ening the base of system o^ership, devising and using functional feedback 
loops, understanding and clarifying values, understanding and working with ,'the 
.local political circumstances, and obtaining input on system development from ;^ 
persons likely to be affected by the ^system, to name .a. few. However, the 
literature reflects a patfcity of sourqes dealing with the processes and 
procures one would use to address and/or jmplement activities associated 
with these important elements. There is^no parallelism between ttylvast 
literature sources specifying procedures , down to the minutest detail for * 
methodologies procedures (e:g. , sampling), and procedures* or processes needed 

*^ > * ;-' ' - * v ■ 

or required to build in the interpersonal dimension, e.g., system ownership or 
identification and interaction with key gctors. . * \ 

* . l * . ' i , # *' - 

Occasionally someone suggests that more research needs to be initiated in 
this area. It is quite clear from an implementation standpoint that the "fioy/! 
"to" aspects are well covered for methodological' concerns but sorely lacking j 
for interpersonal concerns. Bach must be present in substantial amounts if n ■ 
the implementation is to be successful; If one or both of /ttyfjse characteristics ^ 
are missing, the im^mentation will meet with substantial c(ifficulty ajid the ), * 
probability of ultimate success or \adaption of the system is drastically: \ 
reduced. , K 

Why is it that such 'little attention has been given to this topic in 
the' literature? Is it because we assume that the evaluator will' know how tro . 
deal in the interpersonal arena and further will be sensitive to the nuances • 
of the local situatiqn? Is ft because it is an extremely difficult arena in 
■ whichto work and generalized principles are difficult to identify and each . ^ 

problem is situation specific? Is it because good rigfirous research in this 
~ arena is difficult; and no one wants to get swallowed in a morass of complex and 
. • < r ■ ■' 

• i ' ■ 2 
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constantly shifting .problem focus -founded on' a bed of loose theory? , Perjiaps, 
the topic is not extremely important. More than likely each of the above 
points contributes to'some extent to the current situation. • What is important 

I ' s < \ 

is not that we clearly isolate the causes but rather that we begin to examine, 

the implementation process in more detail. Following those yrquiries we have- 

a stfong need "to discuss, * debate and write about the interpersonal, processes 

involved*in the implementation of anevaluation system. This paper. i§ an 

t- * 

effort in this regard.. „ ' ' * 

Literature Review .; W' \ , 

' A substantial amdffnt of evaluation activity has 6ccurred in the context 
of education. The effectiveness of evaluation, efforts within the more 
specialized context of, higher education has at best been mitffed. Stuff lebeam * 
t 1982 ) ft captions on the difficulty in doing evaluation in higher education. He 
is ,oot alone in issudng his warning' as» the results -of many evaluqMpns^nd i 
evaVuators will readily attest. Some of the possible reasons forfp|i$ 
relatively limited success can be attributed to the limited sophistication and 
development of evaluation theory and methodology. '.Substantial progress has 
been made 4 iri this>£gaT*d during the last decade. This is particularly true if 
one^ examines the litkralure for methodological developments. , However, ohe 
particular aspect of eval uation . ha^^recetVed 1 imited -attention/ That aspect 
is the implementation of art' eval uation system. Guba and Stufflebeam (1970) 
identified the need for research on the implementation process and more, 
pointedly on the weak understanding" and limited knpwledge we possess on th/ 
interpersonal aspects of evaluation- During the decade of the seventies, I 
little conceptual writing and -almost no empirical research were 'conducted/ and 
published iji this area. Stufflebeanrfet al. (1981) repeat-these concerns 
regarding the need to address the implementation of* evaluation. This topic 
remains an unresolved issue. 



During the, same tSi^prame, other waiters were busy conceptualizing v 
evaluation tjj^ory, ai\d specific methodology. In addition there was a substan- 
tial borrowing of methodology from traditional inquiry orientations. As a 
result there are substantial numbers of references dealing with some. of the 
more mechanical aspects of evaluation. Textbooks and other writings offer 
conceptual and applied>discbssions of $uch topics as sampling, evaluation * - 
design, "evaluation theory, evaluation models, methods of data analysis, sources 
of data, selection of variables, instrument construction, and reporting. of 
data: Mas* references published during this period deal with one or more of 
these topics.. However, there are few references which deal in any detail with, 
the issue of implementation' of these topics. Thisos particularly true when 

one considers the interpersonal dimension necessary to successfully implement * 

* * *■ 

an evaluation. Those references which d& address these isaues are presented 

• ' \ 

below. .vi t , 

- ■ ■ * ' 

p Weiss (1972) devotes a small section of her book (approximately eight 
pages) to interpersonal aspects of evaluation and even offers a few. sugges- • 

oft 

A 

tions on how to deal with these issues*. She follows this line of though^ as. 
.she counsels on the political dimensions of program evaluation (Weiss , 1975). 
This conceptual article, however, offers little assistance oh implementation 
beyond sensitizing thef^e valuator to these key issues. Her. major points include 
the. notions that evaluation is "developed*, implemented and reported in a 
political environment and further that evaluation is ultimately a political 
stance/ 

Dornbusch and Scott (1975) are sensitized to this issue' and discuss at 
Tength the relationship between evaluation, authority and productivity within, 
an organization. While their discussion "of interpersonal interactions is 
primarily circumscribed within the context of administrative control, they do 
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identify many of the^iey .concepts 'whi oh transcend the interpersonal dimensions 
of the evaluation process. 

Most writers provide only passing reference to the interpersonal dimen- t 

i * * 

sions of implementing evaluation systems and devote an occasion-al paragraph*to 

» . v 

the interpersonal issues, e.g. , Rossi and Freeman (1982) , Cronbach et al. • 
(1980), Stufflebeam et al. (1971): Rossi and Freeman, for example, address 
the issues of politic? and ethics. % 

• The concept of ownership (Borich, 19§2) is key to the implementation of * : 
any evaluation System. It is necessary for the key actors and persons most 
~ directly involved in the evaluation effort to feel p^jt of and have ausense of 
belonging to the effort.. Otherwise , the effort is likely to be met wfth 
disinterest, passive resistance or possibly even sabotage. Certainly this 
ownership must be felt at the utilization of results stage , for the process to 
be successfully implemented. Clearly the issue remains as-, to how to effectively 
build ownership. * >v 

It is interesting to note that Stufflebeam and Webster (IS^I) character- 
ize alternative approaches. to evaluation as a) value oriented (accreditation 
certification); b) management information systems; and c) experimental research 
activities. Similarities and differences in both purposes and^practices are 
identified in their writings. The ramifications of these different approaches 
have obvious and sometimes very subtle ramifications with Ve$pect to imple- 
mentation. 

A\m6re general and o'ften methodological orientation to the implementation 

of selected elements qf an evaluation can be found in recent literature. ■ \ ■ 

t > 

Udinsky, Osterlind and Lynch (1981) discuss the implementation of an evalu- 

' ..' - 

ation system from the following perspectives: problems of establishment, 

problems of administration, utilization of results, methodological considera- 
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tions, and standards and ethics/ House (1980) introduces the notion of fair^ 
ness and describes at, length seven majbr elements in this doctrine. Broskowski 
and Driscoll (1978) comment on the n^ed to understand and use principles of 
organizational structure when working on program evaluation. ^ This perspective 
is highly reflective of an administrative Science discipline. » 

^ t If one goes slightly beyond the fieCId o\ -evaluation and. probes the general 

\ § V 

area of implementation there is a very interesting discussion by Berman and - 

„ McLaughlin (1978) on research they conducted on implementing and sustaining 
innovations within an educational context. - -A definite parallel can be drawn 

^between the principles and mechanisms delineated by these authors as important 
for achieving success in implemen^j^ an innovative educational program an<t 
implementing kn evaluation system. A highlighting af these principles^ stra-1^ 
tegies and research findings are presented below\ * ^ 

KEY, INGREDIENTS FOR SUCCESS 

1. organizational policy instruments need to be in place or developed in 
concert with the implementation % % 

2. key actors are critical to the process and must be involved 
v3. strong leadership is essentiaRfar success 

4. ambitious and demanding innovations promoted change and continuation 

5. there is a definite need for clarity of goals and precepts * 

6. a step by step sequence qyf activities is very' important 

7. local ownership of effort needs to be developed 

8. the environment needs to be supportive of the effort * % 
In concert with the eight ke^ ingredients, they also, identified a number of 
strategies which were associated with "successful" projects. A listing of \ 
these'strategies is presented below. 



1 \ 

STRATEGIES ASSOCIATED WITH SUCCESS 

1. ' strategies must be'practic£n -and applied in a cohesive and organised 

. ;v ■ : ' * > ■ , - » . ' - 

fashion- . . ' * ' • < " ' \ * 

2. there needs to be cQt^R^te, specific and ongoing teaming of .people : d<m$ 



, the. implementation to develop staf f#t%QTvement and .mutual adaptati^n 1 ^ 

., \, • v. • :> " : - * 4 

3. there needs to be dfrect assistance to users that is both relevant and 

: V ' •• ■ 

• practical. * ' 1 ^ * 

4. 'there needs to be direct and ongoing observation ;of activities 

5. there needs to be regular meetings of staff dealing with substantive ^ 
rather t^hali administrative or routine matters . " ' . " * 

6. there is need for user participation -in decision making—there is a- 
strong, relationship between participation and success 

7. there needs to be local involvement in 'materials development , 

8. there needs to be direct administrative participation in the effort 

On the other side of the coin, Bermln and McLaughlin isolated several stra- 
tegies which consistently did*not result in success on implementation. These 
unsuccessful strategies are presented below. 
UNSUCCESSFUL STRATEGIES * % 

1. . use of outside consultants ^ ^ ^ 

2. packaged management plans ' 
3\ one shot preimplementation training 
4: pay for participant trailing 

(5. formal eval uations , 
6. comprehensive projects . t . ■ 

I Out of this extensive research effort and beyond the successful -and unsuccess- 
ful strategies they* 1defhrtn.ed there were four generalized implications. 
Thfese implications are: 



26 



GENERAL IMPLICATIONS FOR SUCCESSFUL IMPLEMENTATION 

1. be realistic in terms of time necessary to implement and the potential 
effect of impact 

2. attention is needed at all stages of implementation 

3. assistance is needed on implementation 

a. system focused 

b. continuity 

c. practitioner based 

d. process oriented - ■ 

4. efforts need to be made to improve the skill level of actors to manage 
implementation 

The overwhelming conclusion that^pne has as a result of both reviewing 
the availably -literature as well as initiating the implementation of an 
evaluation system is that the future success of the system is constrained more 
by the quality of the interpersonal/interactional dimension than by the metho- 
dological/technical dimensions. At this juncture; there is sufficient and 
adequate methodology to/carry the system. The more tenuous, fragile and 
potentially volatile Aspects of the system are the interpersonal/interactional. 
Unfortunately, this/liability is discussed in 1 i mi tec^ detail in the literature. 

Identification of /Key Implementation Elements 

/ \ . 

• Given the information available in the literature and the need to begin 

implementing an evaluatiori system, an effort was made to identify as many of 
the important and relevant elements as possible. Following this identifica- 
tion, the elements were arbitrarily classified into one of three categories. 
Each issue was placed in either an administrative, methodological or inter- 
personal category. A given element may fall into more than one category but 
for brevity it was listed in only one. Aa can be readily se'en in Table 1, 
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there are substantial numbers of elements listed under each category. When 
viewed from' this perspective, the implementation task appears to be formida- 



ble. It is surprising that so little literature is allocated to such an 
important topic. 



Table 1 

Categorization of Issues Involved in Implementation 



Methodological / 
Procedural 
1) sampling 

^2) instrument 
construction ■ 

3) evaluation design 

4) sources of data - 

5) audience 

6) research 

7) data storage and 
retrieval 



Interpersonal 
Interaction 



Administrative 



T V 

± J 


ownership and 


1) 


nnlirv pxami nation 




involvement 




devel oDment 


C J 


anxiety 


2) 


staffing 


«J J 


organization support 


3) 


admi ni strati ve suDDort 

%Jk VI III | II 1 w *W 1 j*m w 1 V w « w 1 w 


a\ 

" J 


variable selection 


4) 


fiscal suDDort 




values 


5) 


resource support 


D J 


criteria setting 




( snacp pauiDment^ 


l\ 
I j 


feedback loop 


6) 


user guidelines 


8^ 


receptivity 


7) 


user of data 


9) 


leadership 


8) 


agreements/contracts 


10) 


competence 


9) 


roles and functions 


11) 


visibil ity 


10) 


allocation of resources 


12) 


identification of 


ID 


costs ; 




key actors 


12) 


standards 


13) 


politics ^ 


13) 


concern, for disruption 


14) 


turf 


14) 


planning 


15) 


organizational 


15) 


management 




awareness 


16) 


practicality 


16) 


appraising, judging 






17) 


goal clarity 






18) 


task selection 






19) 


access to data sources 




20) 


ethics 






21) 


conflict of interest 






22) 


design agreement 






23-) 


timing 






24) 


util ization, 






25) 


communication 






26) 


personality differences 




27) 


interests * ' 






28) 


changes in status quo 






29) 


status rivalry 







0 

ERIC 



The writings in the literature reflect primary emphasis upon the metho- 
dological /procedural and secondary emphasis upon the administrative. The 
interpersonal dimension comes in a distant third. However, Table 1 reflects 
more elements in the interpersonal category than the other two categories 
combined. Realizing that the classification system is very crude and while 
one may quarrel with the classification of an element the overall message is 
clear. If we are to be successful in implementing a program evaluation system 
we must begin to pay more focused attention to the interpersonal dimensions. 
Further, 6ne could easily add elements to each of the three categories, i.e., 
the categories are not exhaustive and only representative of possible entries. 
How has this delineation been of assistance to this effort at implementing an 
eval uation^system? 

implementation of the SIS System . 1 

This paper will attempt to identify a number of specific activities and/or 
strategies that have been initiated at The Ohio State University College of 
Education to begin the implementation process of the'Student Information System. 
This system, as can be seen in its original four purposes and reflected in the 
original data collection matrix, is exceedingly complex. The integration, 
coordination and cooperation necessary for this system to function is enormous. 
If one begins to think afiout the magnitude of the task it can very easily para- 
lyze any potential movement. Therefore a decision was made to move ahead 
realizing the potential dangers of .this decision. 

The next section will identify general procedures which will be followed 
by a chart on each of the three categories identified in Table 1 (methodological, 
interpersonal, and administrative). Each chart lists the elements, one or more 
activities focused on the element, the status of the activities and the strategy 
or principle used in addressing the element. 
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Chart 1 



Methodological Elements, 



Element 

1. Sampling 



2. Instrument 

construction or 
selecti on 



J. Evaluation design 



4. Sources of data 



5 . Audi ence 



6. Research 



Acti vi ty 



Activities arid Strategies 

Status Strategy 



Selection of appropriate method for 
follow up studies, narrative data; 



Create or select instruments with 
input from key actors for content. 
Use instruments that are appropriate 
for task. Determine instrument - 
qual i{y. 

Work with key actors to generate 
appropriate evaluation designs 
within general parameters of ' 
overall system. 



Identify logical sources of data 
and negotiate these with key actors 



Identify logical as well as direct 
audience for feedback of data or data 
reports. Negotiate audiences for data 
reports with actors affected by the 
data. 



Encourage research tp be conducted on 
the system and the data base while 
maintaining professional ethics and 
confidentiality. 



In place 



In place 
In process 



In pi bee 
In process 



In place \ 
In process 



place*, 
process 



In 
In 



/ 



In place 



Use technical skills to decide most 
appropriate techniques to fit overall 
system; keep procedures realistic and 
reasonable. 

Get key actor input into instruments 
which affect their functioning; use 
methodological skills to design and 
test instrument; build in ownership 
of key actors. 

Build key actors into decision process;, 
use methodological skills to generate . 
process/procedures and negotiate with 
key actors ;\keep system simple and ■ 
useable. V 

Keep data requests realistic and timely, 
be concerned about over- using data 
sources; be sensitive to other users' 
requests for data. 

Be sensitive to utilization of data 
and using the data appropriately . 
Make it known, in advanqe, how the . 
data is to be used and don't violate 
such agreements as may be negotiated. 
Make sure the data gets used and have 
a plan for its use. Have a regular 
pattern of^disseminating data. 

Do personal research on pieces of the 
system; encourage master and doctoral 
level students to conduct research on 
the system; secure external support to 
conduct research on various aspects of 
the system; disseminate the research 
findings. 
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Element 

7. Data storage 
and retrieval 



Activity *" " 

Have a systematic plan developed to ^ 
collect, maintain and retrieve the 
dat^in useable, flexible fashion. 
Technical skills and resources need 
to be allocated to this endeavor. 



8. Dissemination 



Plan for systematic and consistent 
dissemination efforts to appropriate 
audiences. Keep reports practical, 
useable and short with available 
back up documentation. 
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Chart 1, p. 2 



Status Strategy 

In place Use computer capabilities; develop a 

short term .and long term plan. .Short 
term plan will be for simple data Vuns 
to be generated to produce immediate 
feedback. The long term plan is to 
deyelop more sophisticated, method^ 
procedures and format of reporting? 
Show immediate pay off of system. 



A 



In process 



A pi ap for dissemination needs to be 
developed and in place. The plan needs 
to include formal as well as informal 
mechanisms. Formal mechanisms Include 
reports to key actors, program heads, 
college administration, conference 
presentations, journal articles* 
monographs, theses, dissertations, ~ 
memos, etc. Informal mechanisms 
include classroom presentations, senate 
verbal reports, discussion groups/ 
faculty interaction, etc • Dissemination 
needs to be regularly scheduled to es- \ 
tablish and maintain visibility and 
credibility. Involve key actors and 
all affected by information tft.dissemi- . 
nations, decisions, 'and processes. 
Give credit tot all key actors. 




Chart 2 



Element 

I. Ownership and 
Invol vement 



Interpersonal Elements, Activi 
Ac tivity 

■ „ t ■ 

.Working with each program group on 
evaluation system components 
,which affect them .. 



2. Anxiety 



Interpersonal interaction 
and discussion. 



3. Organization support 



4. Variable selection 



5. Values 



Secure support o^-key actors in 
colleges by personal interaction 
and demonstrated payoff of efforts, 



Work with key actors and central- 
administrators to identify, select 
and operational ize variables of 
interest and importance. 

Identify value orientation of key 
actors arid central admini strati on 
with respecj: to content area, data 
systems and use of data. 



6, Criteria setting 



i 

Work with each program group to 
establish criteria on various 
measures. 



7. Fee dbajgjj/ loop 



Provide immediate feedback on 
collected data. 
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t^ies and Strategies , 

Status Strategy , . \- 

V Wortc initiated Initiate one program at a. time and 
•with FEEP and generate interest, involvement and 
P'r Programs ph>vide feedback; work on parts of 
system which affect them . 

Underway Direct work with actors to reassure 

them and to provide a good working 
' * relationship. ' 

Ongoing Demonstrate use of data in visible 

fashion; interact with key actors in 
system! disseminate products of 
system; get visible central adminis- 
< trative support for effort in front 

^ of other key actors. 

Ongoing " Provide suggested list, of variables; 
'Some i/iv buifd^key actor involvement through 

place discission, about which variables to 

(FEEP, Pi) ^ use » work With one program at a time. 

(ingoing Work with key actors and qentral 

administration on personal bases to 
learn what their frame of references 
and valqes are. Be cognizant of valu 
conflicts and bring this to awareness 
of grou^ in order to move group fbr- 
' • . ward. 

Ongoing Involvement of key actors in estab- 

lishing' criteria to help build 
ownership and to keep criteria 
realistic; suggest criteria for 
. .their review and comments. 



FEEP in Show use of data to actors and 

place provide them with useable and timely 

PI in place information; request input from them 
on when and what format to provide 
most appropriate information. 

: ■ / . 
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Activity 

Build support for use of, data system 
through formal and informal .channels. 



Status 



Ongoing 



\ 



Ongoing 



Ongoing 



Get visibility and reasonably 
direction fpr the system established 
in college arid on* larger scale; es- 
tablish sbund conceptual positions 
for system and its various pieces. 

.. j- 

Interact with key actors in 
professional , helpful manner. 



Keep the system and its products in Ongoing 
front of actors on*a regular basis 
through memos\ study products, user 
feedback, college 4 dissemination organs f 
and external activities such as propo- \ 
sals, projects, conferences, presenta- 
tions .-. " 

Through formal and informal means In place 

identify key actors and power brokers Ongoing 
in system and initiate ongoing dialogue 
with these people; e.g\ , department 
chairs, j»*g ram heads, welfl respected 
faculty^ opinion leaders. 



Strategy 

Get data from system into formal 
channels for action, e.g., back ta 
program, on senate agendas, on college 
administraii ve agenda;, build Informal, 
support for use of data through dis- % 
semination of dafta. in college and 
through other interpersonal interactions. : 

Healthy and sound management styje; 
delineate sound conceptuafT^asis for 
various pieces o^ system and make 
sure they fit together; have sound 
and workable, visible pjan of attack. 

Select quality staff with skills to 
t address necessary functions; have^ 
all staff interface with actors in,* 
professional manner through the dem- 
onstration of their skills in operating 
the system . ; 4 . "* ■ 

Provide feedback to users *on a regu- 
lar, timely basis; get system on 
agenda of various programs and college ) 
administration; use in-house dissemina- 
tion organs for visibility; disseminate 
information to actors on a regular , 
basis, e.g., itomary of student Mlow-up. 

Formal identification through table of 
organization— informal identification 
through dialogue with people in formal 
structure as well as discussion with 
key actors. Identify formal and 
informal power structure, use informa- 
tion to facilitate implementation by 
seeking advice and counsel of key actors. 



♦ . : • ' ' ' . X ■ 

Element ~ Activity * Status 

13. Politics Identify nuances,' conflicts, o. Ongoing 

strengths, weaknesses and agendas of 
^each program through discussions with 
various program personnel . • " 

. V - 

14. Turf Identify area's where key actors Ongoing 

assume proprietary rights or logical 
domains through the formal organization 
structure and informal discussions^ 
Identify degree of personal posses- 
si veness. 

r 15.' Organizational Identify the parameters, constraints,- Ongoing 

awareness programs and activities within the 

college, 

■ . ' ; . * . • 

, r.' . ^ : 

16.. Appraising, judging "Appraising and judging must be done Ongoing 
> when one interprets data. Efforts 

have been made to involve key actors 
in assisting with data interpretatiojjp 

% 

17. Goal clarity Delineating and clarifying the major . Ongoing 

* . v v directions of the system, interacting 
with key decision makers and program 
heads to bring the system from papfer 
to reality. _ . " 

■18: Task selection Interacting with key decision makers Ongoing 

to identify hi gh priority tasks to 
be implemented. 



r 
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Chart 2, p. 3 

Strategy 

Use information to help guide, decision ; 
making in implementation; use awareness^, 
data to help overcome resistance by ^ 
anticipating the posture of various 
.actors to proposed changes. 

i , ' ••• '■ ■■' 

Be sensitive to -various domains and 
use this information to assist in 
guiding implementation effort. 



Knowing how the organization functions 
can be an asset when decisions need 
to be made; the. information provides 
a context and a series of existing 
mechanisms to .assist with implementation 

involve key act&rs and 'attain istrators 
in the interpretation of dSPta • This - 
helps to build in ownership as well as: 
providing a strong reality base to the * 
outcomes. 

Involve key actors and administrators 
in the development and implementation 
of the system to build in ownership, 
awareness and visibility. / '*-\'-' 

V " "■■ ; _ • . . ; . - ' 

Start with a small task whe,re there > 
is good chance of immediate success 
in order to gain credence and visibi- 
lity; move systematically through, 
tasks as each becomes operational or 
routinized. Work on one task at c a 
time being sensitive to impending 
needs , politics and other pressures. 
Involve key actors iri decision process;,. 



Element 



Activity' 



Status 



19 Access to Develop working relationships with Ongoing 

data sources key actors who control^ access to 

various kinds and levels of data. 
Establish procedures an4/or mecha- 
nisms to access needed data. 



20. Ethics . Identify ethical and unethical uses Ongoing 

of data, maintain confidentiality of 
data; guard against unethical use of 
data; convey this information to key 
actors, sources of data, etc. 

21. Conflict of interest Be alert to .possible conflict of Ongoing 
: interest activities and situations; 

avoid such situations and apprise 
key decision makers of potential 
problems when situation arises. 

22 Design agreement Involve key actors in various aspects Ongoing 

of the system design; seek consensual 
agreement before implementation. 

23 Timing - Identify major time frame and various Ongoing 
. . ' activities in general plan. Discifss 

and negotiate timing of activities 
with key actors in light of constraints. 



24 Utilization Work with key actors to provide Ongoing 

feedback on data and'* develop with 
them mechanisms for use of data. 

a 40 
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Chart 2, p. 4 



Strategy ■ ' • . 

Identify data sources, needs, „and 
time frames for data; negotiate 
access to data* with key actbrs. 
Involve these actors in the decision 
process. Share results immediately- 
with key actors, give credit to data 
sources and key actors. 

Establish and maintain ethical posture 
and integrity of operation. Convey 
picture of competent and responsible 
professional behavior, 

Mai nta+iKProf essi onal and ethical 
posture. \Enhance credibility, avoid 
cpnf li cts w i n teres t through' sensi - 
tivity andjawareness of actions. 



Generate wormian and share with key 
actors for revieV/,. input and revision 
through ongoing working relationship; 
encourage participation and involve- 
ment V/ith all actors to be affected 
by design. 

Share thinking with, key actors and 
involve them in deciding on when 
activities will occur within general 
time frame; allow sufficient time to 
accomplish tasks and maintain limited 
.numbers of concommi ttant activities. 

Establish a plan with each key actor 
for use of the data (before data is 
collected). Utilization must be part 
of system for the system to have in- 
tended impact; turn data around rapid- 
ly, efficiently and in useable fashion. 



/ 



Element 



25. Communication 



26. Personality 
di fferences 



27* Interests . 



28. Changes in 
status quo 



29. Status rivalry 
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Activity 

Establish and maintain 
•communication with all 
actors in the system. 



open lines 
levels of 



Status 



of Ongoing 



Identify personality differences 
between key actors. Be sensitive 
to these differences and attempt to 
take these factors into account during 
the planning and operating stages. 

Identify and be aware of interests 
of key actors as they may be in line 
or in opposition to proposed direction 
of system. 



Ongoing 



Ongoing 



Be sensitive to reactions about pro- 
posed changes in the, status quo to a 
different set of operations. Plan for 
dea]ing with these reactions through 
sensitizing the actors and data sources 
to the proposed change before it occurs 



Be aware .and sensitive to potential 
reactions to the visibility of the 
system as it reflects upon the leader. 
Colleagues will not always react posi- 
tively to efforts, or success. 



Ongoing 



Ongoing 



Chart 2, p. 5 . V 

. A 

Strategy 

Communication i§ a necessary but ntft 
sufficient element for successful 
implementation. Without consistent 
and ongoing communication thraugh 
formal written and verbal presentations 
as well as informal interaction the^ 
system will have difficulty in. func- 
tioning. . 

Being sensitive to and aware of 
personality differences can be help- 
ful; for example, by npt scheduling 
the conflicting parties to directly 
interact unless absolutely necessary 
or by othe^brtdging techniques. 

Use information on interests* of key 
actors to increase their involvement 
in the system if the interest is in 
line with system; or to be cautious 
about a direction or reaction to a 
proposed idea if the interests are in 
opposition to the system. Such sensi- 
tivity can help avoid potential con- 
flicts and confrontations. 

Develop and use plans to systematically 
introduce changes in the status quo. 
Involve key actors in the decision pro- 
cess and keep them apprised of current 
status. Desensitize actors by intro- 
ducing changes gradually over time and 
with their knowledge before it occurs. 

Sharer credit for the system with all 
actors. Build in as much ownership as 
possible. Maintain personal low profil 
on sharing credit. Use key actors to 
present findings as appropriate. 
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Element 

1. Policy examination/ 
development 



2. Fiscal support 



Administrative 
support 

4. Staffing 



5. Resource support 



6. User guidelines 



7. Use of data 



8. Agreements/contracts 



9. Roles and functions 



Chart 3 



Administrative Elements, Activities and Strategy 



Activity 

Col lege Senate adopts policy 
governing and authorizing system. 

Secure money from central 
administration. to operate system 



Oo 



Involve central administration in 
decision making, public communications 
of system and ongoing activities. 

Hire staff with interpersonal, 
methodological and teacher education 
skills (staff skill must complement 
each other). 

Secure necessary space, equipment 
from central administration to 
operate system. 

Generate draft guidelines U line 
with policies on system users 
\{ confidentiality) for debate, revision 
and adoption through College Senate. 

Get draft guidelines developed for 
review, revision and adoption by 
College Senate. 

Generate and secure working agreements 
and/pr contracts with agencies, 
offices, .programs, individuals. 



Clearly delineate roles and functions 
to all persons participating and/or 
affected by system. 



. Status 
In place 



In place 



I Continual 



Staff in 
pi ace 



In place 



In process 



In profcess 



^e^s 



Strategy^ 

Work with central administration and" 
key senate members to draft policies, 
build support and get policies adopted 

Negotiate for necessary fiscal support 
efore you commit to task; obtain 
budget control , 

Gfet visible, consistent conmitment 
of time, interest and activity from 
central administration. 

Delineate roles and functions neces- 
sary to achieve reasonable outcome 
and secure those skills in staff. 



Negotiate for centralized space and 
adequate resources to complete job. 

Work with key senate members and cen- 
tral administration to develop user 
guidelines; get guidelines supported 
by key actors through peer input. 

Work with key senate members and 
central administration to develop, 
revise, and adopt data use guidelines, 



Some in place' Set up agreements as part of working 
Some in process relationship but in advance of 
1 actual evaluation activity; work 
collaboratively with key actors; 
get information in writing. 



Some yet to be 
developed 



In process 
Some in place 
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Set up job descriptions, roles and 
functions that are visible', known 
and sanctioned by all persons 
involved in systejp c 



Element 

10. Allocation 
^of resources 



Acti vi ty 



Status 



* Select tasks on which to work and t In plade 
begin allocation of resources to task. Continual 



11. Costs 



entify majorVosts and decide In place 

ich alternatives to select among. Continual 



12. Standards 



Identify and delineate standards 

of operation. Make standards visible 

and public . 



In process 



13. Concern for Collection of data at various points Continual 

disruption in the educational program resulting 

in potential disruption of ongoing 
process. . 



14. Planning " Have a reasonable and systematic Ongoing 

■; plan to implement the effort. 

15. Management Orchestrate and coordinate many Ongoing 

pieces of action, people, and resources. 



16. Practicality * Keep system reasonable, manageable Ongoing 

so as to not overwhelm actor. 
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Strategy 

Work collaboratively with staff to 
kfcef^ work load reasonable , forward 
/and oh target. Utilize staff skill 
hrough delegation and cooperation, 
ontirtually reinforce positive staff 
ehavior. 

Involve staft^n^decision making 
through alternatives identified and 
actual input into decisions. 1 Keep 
costs reasonable and within budgetary 
limits . 

Clearly identify frame of reference 
for all actors and what standards 
will be accepted; use existing 
standards, document as resource 
support 

Awareness of regular process and 
establish working relationship with* 
each actor so that timing oftdata 
collection can be appropriate and 
meaningful with minimum disruption. 
Make data useable by and available 
to actor . 

Involve key actors in parts which 
affect them; have staff input into 
plan; move one step at a time get 
piefces into place . 

Operate o^ sound and consistent 
management principles, involve key 
actors, have staff participate in 
decisions; maintain fli^x^bili ty. 

Maintain perspective, get external 
advice, involve many levels of 
people and obtain input, look for 
important elements in system and s 
focus attention on them. 1 
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* fl^ The overarching strategy is to begin implementation before the conceptualized 
system has been finalized (the system has been under development for three years). 
Individual pieces are being initiated while the qverall system is being completed 
. and/or modified.^ A second general strategy is that the system is an open system^ 
and therefore. capable of being modified, expanded or contracted:' A third general 

4 strategy is to move the system forward one* step^at a time, by plan, rather than 
trying toliTi^Tement the entire system at once. These individual steps may be 
occurring in rapid succession or even simultaneously if the circumstances per- 

. mit. On the other hand, some steps are exceedingly plodding and slow. 

The reader should realize that the elements presented in Table 1 are not N 
in any order of priority or other temporal cla»ssifica|i|on. Obviously certain 
' - of the el ements^kjst occur before others can be considered. A second obvious 
note is that wry few of the elements listed under each of the three categories 
is pure.' Each element typically has some relationship with the other cate- 
gories. What is painfully clear is the tremendous amount of interpersonal 
interaction involved in the entire implementation process. 

5 " The three charts (Chart 1 Methodological, Chart 2 Interpersonal and Chart 
3 Administrative) have been useful to us in guiding our implementation efforts. 
We realize that there are many other strategies and activities which we could 
use and perhaps individuals may' suggest that oije or more of our actions were 
ill advised. What we have done is not perfect but we are willing to share our 
experiences, successes and frustrations. We- bel ieve that dialogue and debate 
on these topics is essential if we. are going to productively move forward. 

As a general statement, we have moved rather cautiously in a step by step 
fashion attempting to implement the data matrix presented by Dr. Zimpher. In 
summary form the following pieces, or items presented below in Table 2 have been 
implemented. We will -Continue to move forward and try to make the system come 
alive. * 
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Table 2 , 

Implementation Status Matrix of SJS 



descriptive _4 Assessment Narrative Context 



Preprofessional 
Data 


Demographic and 
Historical Data 


Htgh School Data N 
ACT/SAT 

GPA ' 




— ^ 


Professional ! 

! 

Freshman* : 
(FEEP) ; 

i 


Course 

descriptions 
Myers Briggs 
Personal! ty 
Inventory 
Commitment 
* Request 


Teacher Candidate 
Profile (D 
Grades 

i 

- 


Personal 

Growth 

Plan 

\ 




C Ann AVV1AMA 

oopnomore » 
(PI) 


Plfl |V*CO 

^descriptions 
Field Placement 
Requests 


Teacher Candidate 
Profile (X (D 
Grades 

- 


Cri tical . 
Event j. 
Form Q)/ 


.4 


Special Methods 
bourses 


Course 
descriptions 


Grades 

1 ; — f 


■ 

\ 

* 




Content Specialty 
Courses 


Course 
descriptions 


Grades 

i 




\ 


^foundations 
Courses 


\ Course 

descriptions 


| Grades 

! ; 


\ 
1 
1 

- 1 

i 

■ : 


Student 
Teaching 


i ■ 

Course 

descriptions 
Field Placement 


! Grades 

j 

i 


» 

I ■ 

i 

i 

* 


• 

Postgraduation" 

i 


: Course 

j descriptions 

1* Follow- Up 

! Demographics 
Observations 
Interviews 


i 
i 




i 
i 
i 



0 = Schreck paper 
2)= Reighart paper 
^3)= Lemish paper , 
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Note the numbers 1, 2, and 3 listed in the Status Matrix. Thj^e numbers 
identify the areas of the matrix from which we have extracted three examples 
of studies- conducted on the system. These numbers reflect the presentations 
to follow by (1) Ann schreck, (2) Penny Reighart, and (3) Peter Lemish. 

Over and above the items on the matrix, a number of other important 
activities have beep initiated or completed. These activities, are listed 
below along with their status. • , 



Activity 



Status 



1. SIS Policy ■ * '. 

a. Development 

b. Process for College Senate Approval 

2. User Guidel/fnes v 

a. DeveTppment ' i 

b. Process for .Col lege Senate Approval 



3. Access Guidelines to Data Base Information 

a. Development 

b. Process for College Senate Approval 

4. Involve key actors^ 



5. Involve College Administrators 

6. Develop Feedback ftechanisfc- to Report 
TCP Data to Feep and PI 

7. Plan for Computer Storage and Retrieval 
of Data 

8. Identify Documentation of Individual 
Program Requirements 

"9. Conduct Research on Components of the 
System 

a. Four studies 

b. Two studies 

10. VConduct Annual Follow-up of Students 

a. 1981 follow-up 

b. 1982 follow-up 

11. Pilot Test National Teachers Exam 



5( 



completed 
completed 



completed 
in process 



completed 
in process 

in process 

completed-on-going 

- ♦ 

completed 



in process 



completed- 



completed 
in process 



completed 
in process 

completed 
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Activity 



Status 



12. Acquire Staff and sfrace for the System 



completed \ 

13. Develop Documentation for Accreditation Visits in process 



The system continues to be well received and is moving forward, 
is to continue to move forward. 



r 
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IV. A Focused Evaluation df the Student Information System 

Ann L Schreck 
Graduate Research Associate 
College of Education 
The Ohi'o State University 

Introduction „ • 

An evaluation of the Student Information System (SIS) was conducted after 
the system had been under development for two years. The conceptual basis and 
design of SIS had evolved from the developers' awareness of teacher education 
evaluation issues and concerns and their desire to create an. evaluation ap- 
proach which provides extensive information about many key aspects of teacher 
candidates, and their educational program for the improvement of tioth. The 
purpose of this evaluation was to collect, analyze and present information 
about the implementation of SIS. Specifically, the evaluation focused on a 
teacher candidate profile questionnaire administered to students enrolled in a 
sophomore level Professional Introduction course Winter quarter, 1982. The, 
instructor and cooperating teacher for the field experience part of the course 
completed the questionnaire for each student as well. 

In terms of data matrix of SIS (Zimpher, 1983), the block formed by the 
intersection of the Professional Introduction (sophomore level students) and 
Assessment categories pinpoints the area on which this evaluation focused. 
Professional Introduction Questionnaire 

The questionnaire studied in this evaluation was called the Professional 
Introduction (PI) Teacher Candidate Profile (TCP). It was an eleven item 
instrument divided into four Sections: 1) generic skills (four it6ms), 2) 
skills relating to the PI curriculum (two items), 3) skills specific to a. 

particular lesson or lessons (three items) and 4) setting of the studenjt 1 „ 

1 
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teaching experience (one item). The items allowed ji rating on a five point 
scale, from inadequate or low qua\ijty to outstanding or high quality. The 
/ setting item scale 'ranged from exceptionally difficult to exceptionally easy.. 

One hundred twenty-two students were rated, each by themselves, their instruc- 
tor and cooperating teacher. Thus, a total of 366 questionnaires were com- 
pleted. 

Descriptive sta^tics computed f rom^results* of the questionnaire showed 
,an o*rall high average 1 (X > 3.9) for each item. No significant differences 
between the three groups of raters (students, instructors and cooperating 
teachers) were found for any item except one; student's execution of a teach- 
ing unit. For this item, the scale had been reversed high to low instead of 
the opposite as 'were the rest of the items. This reversal in the rating scale 
may have gone unnoticed by some respondents and accounted for the difference 
detected between raters. 

The high, uniform nature of the responses for each group raised questions 
about the construction of the items in the instrument. It was found that the 
items were very general and provided no criteria by which judgments were to be 

made about student behavior. Individual raters may have used different standards 

C 

to make decisions about ratings. This type of situation may also have allowed 
a halo effect to occur as the lack of a standard may have resulted in a variety 
of self-imposed and non-equal standards being used by the various raters. 

Since the raters were to sign their names to the questionnaire, fear of 
the consequences of the results may have prompted high, favorable ratings. 
When unsure of the item or its subsequent interpretations and use, it may have 
seemed safer to give favorable rather than unfavorable results. Assurance of 
confidentiality and hoiVest discussion of how the results will be used and why 
might alleviate this problem iri'ttie future. t 
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The question of validity of the instrument and its results were raised as 

• . ' . * /»■* 

no clear doc k umentation was evident to describe exactly what the qtfestionnai re 
was supposed to measure or how the results were to be used. An item speci- 
fication matrix and/or review and approval by an expert panel consisting of 
the instrument developers anci potential users might have provided evidence of 
content validity, i.e., the instrument was a representative sample of all 
possible items that could have been asked about the PI 1 course and contained a 
reasonable proportion of items for each area of concern. 

The underlying constructs the questionnaire was attempting to assess were 
vaguely described to be generic teaching skills or competencies and skills 
specific to the course for which it was administered. Controversy has loomed 
over what competencies a teacher must have in order to function adequately in 
her or his career. The items concerning ratings of clarity, enthusiasm and 
time management included in the questionnaire appeared to be measuring some 
proposed constructs of teacher competency. The reason for the selection of 
these particular items was not documented. In order tc validate inferences 

i 

drawn from the questionnaire in terms of constructs, the constructs themselves 
must be clearly articulated. This would provide the groundwork for further 
study of the construct validity of the questionnaire's results. 

Beyond the descriptive validity (content and construct) issues described 
above, the decision-making validity of the results was questioned. First, 
were any decisions to be made based on the results of the questionnaire? One 
of the specified purposes of SIS is to diagnose student progress in order to 
counsel and advise students. Are results of the questionnaire to serve as 
predictors of future performance?' Will these predictions be considered when 
counseling students? Are only descriptive inferences to be drawn from the PI 
instrument? No clear plan or guide was set as to how the results would be 
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interpreted or used. If the results are to be predictive of future behaviors, 
those behaviors need to be specified. After a reasonable length of time has 
elapsed, studies can be undertaken to determine if the ratings received by 
students are a suitable base upon which to predict performance in future 
courses or performance as teachers in the field. 

Validity is an important concern in the area of assessment. Due to the 
identified problems with the construction of the questionnaire and the lack of , 
documentation as to what it is supposed supposed to be measuring, the validity f 
of the instrument ^nd its results were questioned. This issue of validity is 
in need of constant monitoring and evaluation in order for the instruments to 
be proven accura^, useful indicators of students 1 educational development. 

The reliability of the instrument was evaluated in terms of its internal 
consistency. The reliability coefficient computed for the instrument was 
relatively low (Alpha = .511, £< .05). This may have been due to the diversity 
of the items and their few number. A lengthier instrument with specific 
sections might permit the internal consistency of individual sections of. 
similar items to be analyzed. 

Inter-rater reliability was assessed by comparing ratings for a particular 
student by the student 'him or herself, his, or her instructor and cooperating 
teacher 1 . This process was referred to as triangulation. Correlation coef- 
ficients computed for the responses of each trio showed some to have signi- 
ficant positive results while others had insignificant positive or negative 
correlations. It was found that for some trios all three raters were in 
agreement. In others, twi or all three individuals differed on the averages 
of their rai/rn^s by one or more points. This analysis provided some evidence 
of discrepancies among raters which was lost in^the^veral 1 group analysis. 
The ]9k of consistency among raters might have been caused by their indivi- 
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dual interpretations of the items. Varying implicit standards for rating the 

J 

students may have also accounted for some of the differences. Clarifying the 
items and specifying the criteria for ratings may serve to provide a/common 
understanding among all raters. If the ratings show true differences in 
opinion, ^Inferences between raters may be useful to understand the differ- 
ences and to work toward a common standard so students will know what is 
expected of them and what particular areas are in need of improvement. 

As with the validity issues of the questionnaire, the reliability of the 
instrument must continue to be monitored and efforts made to improve and then 
maintain it. . 

A final concern about the TCP instrument was the feedback and use of the 
information gathered with it. At the time of this evaluation study, little 
could be seen in terms of the plans by which the information would get to 
individuals it is supposed to serve, j^fctidents would. gain access eventually 
whether through manual files or a computerized system of data storage and 
retrieval. Feedback of information was to begin once SIS has been adopted 
formally as policy of the college. 

Although early in fts development , iKwould be of benefit to make the 
information collected about students available to 1 them. This could indicate 
twtf things, (1) do t^e studenfs bother to look at the information?. And, 
(2) what do they do once they have seen it? If students fail to use the 

A 

information or make no apparent attempts to change or seek help once they have 
seen it, this may indicate the system is not working and should be modified to 
instruct and encoura^students of its use. 

Similarly, instructors and administrators did not demonstrate their use 
of the information. No evidence was found to indicate that either instructors 
program developers or coordinators had studied results of the questionnaire 
used or made changes because of it. 

* 5. 
V 
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This lack of feedback will undermine the accomplishment of two important 
purposes of Sl£ to diagnose student progress for counseling and advising 
functions and to evaluate students for their improvement as well as that of 
the entire program. There appeared to be an emphasis on data collection but 
not its use. While the former must be completed before the latter is carried 

r 

out, it is probably important to plan some measure of vtfiether or not the in- 
formation is used.. When students are advised to do certain things or program 
modifications are made base& on the information gathered, these two important 
goals of SIS can be better evaluated. 
Summary 



\t the time of this study SIS and the TCP instrument had been under 
development for well over a year and were still in need of refinement. 
Assumptions and theories underlying the assessment approaches had not been 
made explicit in the documentation of the system. The SIS lacked a focus on 
any particular evaluation questions. Likewise, the plans for the use of 
information gathered with an instrument within SIS was lacking. The system 
stressed- description, but, failed to indicate how inf>f < mation wa s to be used. 
Setting guidelines such as: students rated below average on three or more 
skills should be recycled, may help those who receive tt^e information know 
what to do with it. 

Projected users of the information may become better aware of its purpose 
and possible uses if they are" involved in developing the items to appear on 
the instrument. The assessment instrument was constructed by the (Jfvelopers 
of SIS. It is understood that instrument development his to begin somewhere, 
but the instruments might be of more use if students, instructors or coun- n 
selors were involved in the development process. The collecti6n of data which 
serves no apparent- purpose may annoy or burden program participants to the 
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point where they resist the entire SIS effort. The questionnaires have now 
been revised and instructor input has been sought. This process should 
continue and include input from students and administrators as well. 

Plans for the Redback of information to users was a weak area in'SIS. 
This problem may be alleviated by designating a person or team of people 
responsible for getting information to users. These coordinators or 
facilitators Should be able to interpret or condense findings in a way to make 
it most useful to decision makers. Until the use af SIS data becomes an 
autonomous- and voluntary act these individuals can see that information is 
presented to potential users and its purposes understood. Efforts which 
contribute to the understanding of SIS and each of its components should be 
developed and implemented. 

Accuracy oft information is as important as its feedback and must be 
assured before users receive it. The instruments have not been proven to be 



valid, reliable indicators of studerit performance. Validity has been limited 
to the developers 1 subjective judgmenj^|lhe content the instruments are to 
cover and the constructs they are saiq| Jbe measuring should be specified. 
Without knowing the proposed content and underlying constructs it is difficult 

to. determine if the instruments are valid. ^ 

The reliability of the questionnaire studied was found to be weak. 
Raters did not always agree on ratings they had given students. To enhance 
interrater reliability it is suggested that items be better defined or examples 
provided to assure v accurate interpretations. Standards for evaluating students, 
should be set for each item to allow a common understanding of what is the 
expected hehavior of a competent individual at that point in the curriculum. 
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Biased responses may have resulted from students peVceiving the assessment 
as a threat or exposure of their weaknesses. Confidentiality should be assured 
and maintained, Less apprehension about who sees the' 1 results and what, is done 
with them may aljow' a perspn to give honest, accurate responses. 

Once the validity and reliability of information have been demonstrated, 
careful analysis of the data must be carried out to assure accurate inter- 
pretation of results. Analysis of group data may mask individual differences. ' 
Group data may be appropriate for high level decision makers, but analysis of 
each individual's responses are necessary for students who mp^ make decisions 
about their careers, or counselors ^and instructors responsible for guiding f 
individual students. ' _ [* 

Once valid, reliable data and accurate appropriate statistics have been 
secured one would be better able to assess the impact of the TCP as an integral 
element of SIS. Indicators should be developed to determine if changes for 

4 

improvement are resulting from the use of the TCP. These might be regular 
surveys or interviews asking if SIS data has caused users to Change in tt»ir 
attitudes or behavior. These results may also provide information about 
weaknesses in SIS and collect ideas on how it might be improved. 

SIS is an ambitious effort to improve and ensure the quality of teachers 
graduated from the College of Education. Some- of tlje strengths and weaknesses 
of one instrument used within SIS have been identified in thi s/report as well 
as recommendations for improvement. If efforts are continued to refine and. 
improve the assessment 'instruments there is a better chance that SIS will be 
able to prove its effectiveness jis a documentation system. Serious 
reconsiderations should be given to the purposes of SIS and the plans for 
feedback and decision-making if the system is to prove itself to be an 
effective evaluation system. 
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V. Improvemenlfend Use of the Student Information System Teacher 
Candidate Profile instrument 

Penelope A. Reighart and Zelda J. Holcomb 

Graduate Research Associates >; 
College of Education 
The Ohio State University 

The Teacher Candidate Profile (TCP) instrument is designed to provide 

assessments of pceservice teacher performance during several stages of the 

undergtraduate program. This paper describes the continued development and use 

of the TCP instrument in two field-based professional preparation cor^ courses. 

-The first course is the Freshman Early Experiencing Program (FEEP) and 

involves 160 hours of field observation and^participation arid 30 hours of 

small group seminars during a ten week quarter. Emphasis is placed on student 

exploration of the teaching profession and of self in the teaching role. 

The second course, generally taken in the sophomore year, is the second 

.part 'of a two course sequence titled Professional Introduction (PI) 451. Thi^ 

six credit hour course includes numerous laboratory teaching experiences and a 

two week intensive field experience near the end of the quarter. The Teacher 

Candidate Profile instrument is completed at the end of the field experience 

4 

component in both FEEP and PI 451. 
Description of the TCP Instrument ' 

The Autumn 1982 version of the FEEP TCP instrument contains 18 items 
dealing with five areas of performance. The first area (J items) includes 
behaviors identified as important course outcomes, e. g. , exploratory behavior, 
initiative in completing tasks, and participat^n in teacher roles. ^The- 
second area (3 items) includes/the basic communication. skills of reading, 
writing, and speaking. The third-area (6 items) includes general teaching 
skills such as clarity, enthusiasm, professional relationships, and self- 
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evaluation. The fourth and fifth areas include one item each on difficulty of 
setting and overall performance. # 

The five-point assessment scale ranges from a low rating of needs 
substantial development to a high rating of, greatly exceeds expectations. An 
overall standard for comparing student performance reads, "Relative to the 
level expected of a first year teacher education exploration student. 11 ^A 
>triangulated comparison of ratings is achieved by having three Vaters (the 
jrourse instructor, the cooperating teacher , an& the indent) complete 
individual assessments of the student's performance. I 

The Autumn 1982 version of the PI 451 TCP instrument contains 16 items 
dealing witTi three areas of performance- The first area (7 items) assesses 
the basic communication skills of ^SUbing, writing, and speaking. The second 
area (7 items) assesses general teaching skills and outcomes of importance to 
the Professional Introduction course. The third section includes two items on 
difficulty of setting and overall performance. A. five-poi nt assessment scale* 
rangfes from a low secTe~ltf inadequate to a high score of outstanding. Again 
three raters (the course instructor, the cooperating teacher, and the student) 
complete the assessment on each student. 

In the Stifdent Information System (SIS) Matrix presented by Zimpher 
(1983), these two forms o,f the Teacher Candidate Profile instrument are found 
in the second column, assessment, and in the first two rows of the professional 
preparation section. * 

Recommendations and Tasks for InTproving and Using the TCP Instrument 
$IF Schreck (1983) evaluated the Winter 1982 version of the PI 451 TCP 
instrument and made the following recommendations: (1) develop specific 
criteria and standards in /order to increase the consistency of judgments, 
(2) document more clearly the content and construct validity, (3) establish a 
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guide'of intended predictions and interpretations of the TCP data, (4) raise 
the level of internal consistency, possibly through a lengthier instrument, 
(5) develop a feedback system in order to provide information ibout the data 
to instructors an€ students, and (6) involve users in instrument construction 
and development' of a feedback system. ; 

<~fiaied on these recoiSWdations and on/ the observations and judgments of 
the Student Information System staff, ^ie/ revisions and processes which have 
been conducted can be organized under three main tasks and an overall goal. 
The three tasks are: (1) continue to improvethe TCP instalment, (2) organize 
procedures for efficient data collection and data analysis., and (3) develop a 
feedback system of TCP data ana/lysis to course i nstructors and* students. The 
major goal has been to involve users in the decisions and processes involved^ 
in improving and using the TCP instrument. 
TCP Instrument Improvement 

Criteria and standards. ] To provide for greater consistency in the x 

: 7~77 

judgments of the three groups of raters, two changes have been made in the 
instrument. First, specif ic criteria or defining attributes have been 
specified to focus the interpretations of the concepts and skills listed in 
the items. For example, the item, "Demonstrated expressive speaking ability," 
includes thfe criteria: wja$\udible, appropriate to setting, appropriate pace. 

To provide a standard and levels of performance which are more explicit 
if* meaning than ilie-^eTrer«r^^ e , inadequate to outstanding, the following 
standards and levels of performance have been considered and used. ^ 
(1) For the earl^field experience course (FEEP) the following standard and \ 

M 

levels of performance have been developed: 

Standard : Relative to the level expected of a first year teacher 
education exploration student, the student, e.g., exhibited 
professional behaviors, i.e., was punctual, responsible; observed 
confidentiality; used appropriate language. 
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Levels of Performance : (1) needs substantial <igvelapment, » 
■<* (2) -needs development, (3) meets basic expectations, (4) exceeds 
basic expectations, and (5) greatly exceeds expectations. 

(2) For the sophomore level course (PI 451) other standards are being 
considered. ^ 

Standard : Relative to the level expected of a student whom I 
would recommend without reservation tcr continue in teacher 
education ; . , 

w 

Standard: Relative to the level of an average student teacher . . 



e ■ 

Standard : Relative to the level of an excellent student-tea* 



Standard : Relative to the level of an experienced teacher ... 

Content and construct validity . Two processes were conducted to increase 
the content validity. One is the previously described process of adding 
defining attributes to each item. These focused and more clearly delineated 
^cfnceptual meanings. Second, a review by eight FEEP faculty members and 
fifteen PI graduate teaching associates provided suggestions on item clarity 
and relevance to preservice teafetoi^^ These suggestions were used 

as bases for item revision, addition, or deletion. 

Construct validation is difficult to achieve. A review of the process- 
product teacher effectiveness research by Medley (1977) included over 260 
behavior items grouped under 38 teacher process elements. These behaviors 
pertain to teaching in the elementary classroom and for the most part are 
related to achievement scores in reading' and arithmetic.. Effective behaviors 
differ for low and high SES pupils. Powell (1978) explained that not single 
behaviors but certain clusters or patterns of teaching behaviors are related 
to different types of learning. Ir 

The performance behaviors included in the TCP instrument fit neither the 
specific behavior items listed by Medley nor the patterns of behaviors de- 
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scribed by Powell. The TCP performance behaviors are probably best described 

\ J " : . ■ . 

as high inference behaviors accompanied Jfy several identifying attri bytes. 

In FEEJKand PI 451V two coreVteacher preparation courses enrolling teacher 

/ ■ 
candidates from all program levels^, it would be inappropriate to have all 

students learn, specific behaviors or patterns of . behaviors shown to be primarily 

related to achievement learning outcomes at the elementary level with low or 

high SES pupils. And, breaking concepts down into operations can increase 

preciseness, but can also fragment concepts beyond Jpcognition (Berliner, 

|976). * \ " 

At this early state of teacher preparation, in field settings of limited 
student responsibility, and'with some naive an^jnostly untrained observers; 
lengthy and complex evaluation instruments are impractical. A^lternAti ve 
suggested by Berliner is to use multiple methods of measurement from different' 
perspej^ves. The TCP triangulated ratings provide for one element of this, 
different perspectives.^ Other assessment procedures in the Student Information 
System will provide multiple methods ojf measuring student performance and 
development. , i 

The choice of items to assess basic communication skills is to promcrte . 
the continued evaluation. of these recognized prerequisite* teaching skills. 
The choice of such teaching behaviors as clarity, enthusiasm, and time 
management was influenced by the early effectiveness literature (Rosenshine & 
Furst, 1971) andby the need to use general rathe/than situation specific 
behaviors. Relevance to course outcomes was another important Selection M 
criterion, 

* Internal consistency . The number of instrument items has been increased 

from eleven on the version evaluated by Schreck (1983) to sixteen on the PI 

451 instrument and eighteen on the FE,EP instrument. This permitted the. analysis 
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• of internal consistency on subsets of items grouped under the headings: basic } 
communication skills, general taeching skills, and for FEEP, outcomes basic to 
•the course. . 

The addition of criteria and standards, referred to eaflier, should also 

contribute to the internal consistency of the instrument, 
if ■ 

* 

Procedures for Data Collection and Analysis . % 

: * A 

The organization of procedures was done in consideration of the etuHofr .? 
quarter evaluation and feedback time constraints. Riming for a one we4k ; 
feedback time frame, the instrument was reformated and directions written so 
that ratings would be submitted irf machine readable form. < A time frame and 
procedures for instrument dispersal, completion of ratings, data analysis, and 
feedback to instructors were established 
Tbe Feedback System 

In order for course instructors to use the TCP analysis to advise and counsel 
. ' students, the feedbatk of information mus£*be both relevant and efficient. 
Individual student statistics /ere needed as well as .group statistics for 
comparative analysis. 

The following types of individual student statistics from the three 
raters (student., instructor, and cooperating teacher) were provided: 
(1) discrepancies — item ratings showing a two point or greater discrepancy 
between the three pairs of raters, (2) means of item subsets by each rater, 
. and (.3) means of each item across all raters providing easy location of' the 
student's strengths and needs. 

.Group statistics incl-uded: (1) means and standard deviations for each> 
item across all raters, (2) means for subsets of items .across each group of 
raters, (3) correlations of item subsets, and (4) internal consistency of item 
subsets. • . * 
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Written reports of data analyses and information orr data interpretations 
and uses were* provided for each instructor. A future goal is to provide 
analyses to enable predictions of student needs for development and future 
performance in teaching situations. 

Involvement of Course Instructors 

Throughout the activities involved in improving the instrument; organizing 
instrument administration and data analysis, and establishing the feedback 
system; the cooperation and participation of course instructors were sought. 
Both group meetings and individual conferences were held. Instructors' concerns 
and judgments were solicited and their suggestions used as bases for instrument 
Revision. A number of instructors expressed Concerns about appropriate uses 
of data and protection of student privacy. In conducting the instrument 

revision different forms of leadership occurred in the two groups of instructors 

i ■ 

One group preferred to have SIS staff take leadership; while the other gfpup 
preferred that leadership come from among. their members. 

Instructors* responded to feedback with interest.^ Those who had 
participated in previous instrument piloting viewed our report of data analysis 
and interpretation as a sign that SIS is becoming functional. 

Results of Data Analysis and Comparison to Previous Data 

The TCP data for Autumn 1982 consisted of the three separate ratings on* 
177 FEEP students and 99 students from PI 451. Thus t^he analysis was conducted 
on a total of 531 FEEP ratings and 297 ratings from PI 451. 'individual 
statistics (for counseling and advising students) included discrepancy analysis 
of the three pairs of raters* means of item subsets by each rater, and means 
foV each item across the three raters. * 

Group statistics included descriptive statistics^ of means and standard 
deviations, means of item subsets by each group of raters, correlations of 
item subsets, and reliability (internal consistency) of item subsets. ^ 
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- Descriptive statistics . From the grpup statistics (summarized in Table 

1), the overall mean, excluding the settihg and overall performance rating, 

for all items across all raters is 4.16 on the five-point scale for FEEP and . 

4.26 for PI 451. These compared with an overall mean of 4.14 from Schreck's 

Winter 1982 PI 451 data. Standard deviations of ratings ranged from .43 to 

.63 for FEEP and .41 to .76 for PI 451. From Schreck's data the rancje of 

standard deviations was- si i-ghtly larger, .65 to 1.16. 

The mearrs of ratings by groups of raters vary more in FEEP (overall item 

means by students = 4.10, instructors = 4.20, and cooperating teachers = 4.18) 

than in P'l 451 (overall 'item means by students = ; 4.26, instructors - 4.21, and 

4 

cooperating teachers = 4.29). In FEEP students rated themselves lower than 
theother two raters; while in PI the instructors gave the lowest ratings. 

Variations by item subsets (basic communication skills, general teaching 
skills, and for FEEP, basic FEEP outcomes) showed ratings which were slightly 
lower forj^EP student ratings on general teaching skills than on basic 
communication skills and basic FEEP outcomes. Little variation occurred 
between the two item subsets (basic communication skills and general teaching 
skills) for PI 451 student ratings. 

The overall item and item subset means are high. The issue of the standard 
of expected performance is thought to be a contributing factor. If a standard 
were established representing th^ final level of performance expected of a 

« 

well qualified beginning teacher, one might expect to see relatively low 

ratings of beginning' preservice teachers and progressively higher ratings 

t . 
through successive stages ; of preservice teacher preparation. 

The FEEP instructors judged this type of standard to be inappropriate. 

They chose a standa\set at a level "of performance expected of a banning 

teacher education exploration student, When they compared item ^ubset means 
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betweerf'jbourse sections, particularly high means were evident tor some sections. 
Since the data was reported to instructors for the first time on the Autumn 
1982 data, their. attention was drawn to this problem. The problem seems to be 
in the lack of differentiation between students who only meet basic expectations 
and those who exceed expectations; for the ratings did show differentiation of 
a few students who it was agreed were below the basic level of expectation, 

A factor which would contribute to" this low level of differentiation 
among mid to high levels of student performance is the individualistic nature 
of evaluating each student in a different field setting. There may be a- tern* 
dency to rate each student relative to the potential. of that student in that 
setting. When a setting is judged to be difficult (by such criteria as number 
of Students, degree of culture change, and complexity and difficulty of teaching 
load), it may be that less is expected of the student in order to exceed basic 
expectations. 

An' overall standard for;, the PI 451 instrument has not yet been established. 
For some items on the Autumn 1982 instrument a standard of what one would 
expect of a potential teacher was used. ~ 

Correlations , Item subset correlations for basic communication skills'" 
ranged from, .58 to ,77 for the FEEP instrument (3 items) and -17 to ,69 for 
the PI 451 instrument (7 items). The general teaching skills correlations for 
the FEEP. instrument (7 items) ranged from .46 to .71 and for -the PI 451 
instrument (7 items) from .24 to .76*/ The subset of seven basic FEEP outcome 
items had a correlation range of ,51 to .71, 

In general both instruments contain subsets of items whidj^are closely 
related. The higher level of correlations among item subsets on the FEEP 
instrument mayMndicate that it has a closed match of items to intended course 
outcomes than .does the PI 451 instrument. 



Reliability . Internal consistency statistics for item subsets in both 
instruments showed high levels of internaj^consistency. The Cronback coef- 
ficient alpha for the three item subsets for the FEEP instrument were: basic' 
communication skills = .85, general teaching skills = .89, and basic FEEP 
outcomes = .91. For the PI 451 instrument they were: basic communication 
skills = .87 and general teaching skills = .86. 

Compared to the Spring 1982 PI 451 instrument, coefficient alpha = .51, * 
the Autumn 1982 TCP instruments have been considerably ''improved on internal 
consistency. 

Summary of Instrument Improvement and Use t 

The Autumn 1982 Teacher Candidate Profile instruments used in freshman and 
sophomore field-based teacher preparation courses have tLen "improved in a 
number of ways. 



The FEEP instrument has more clear f ly defined criteria and overall 
standard. Both instruments more closely match the . outcomes of each; course fcJ 



which they were designed. The instruments have been increased in length from 
11 items to 16 and 18 items. '* 

Procedures for data col lection and analysis have been organized to provide 

for efficient end-of-quarter analysis of data. A feedback/system to report 
individual student and group data to course instructors has been establisfied. 
Throughout the above "activities instructors' judgments were solicited and 
used. a 

The rather high^erall item and item subset means remain a concern. The 
problem of raters differentiating between mid and high levels of teacher, 
candidate performance will continue to, be pursued. 

v T 
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Group Descriptive Statistics on the Autumn Teacher Candidate Profile Ratings 






FEEP 

Autumn 1982 


Peep 

Autumn 1982 


PI 451 
Winter/Spring 1982 




Overall Statistics 






(Schreck) 




r N = Sturipnts X 3 ratinas 
1 Overall X 

\ Rannp nf standard Deviation 


531 
4.16 
.43-. 63 


297 
4.26 
.41-. 76 


366 
4.14 
.65-1.16 


i 


Overall X by students^ 
Overall X by instructors 
Overall X by cooperating. 

toarhorc 
IcaLl Ic 1 b 


4.10 
4.20 
4.18 


4.26 
4.21 

4.29 '* 






Item Subsets 




•• 






' M ci a n c 
rlcailb 










Basic Communication Skills 
by students 
by instructors 
by cooperating 
teachers 


4.17 
4.24 
4.28 


4.25 
4.20 
4.23 


- 




Genera] Teaching Skills 
by students 
hv i trurtnrs 
w by cooperating 
teachers 


4.09^ 
4.20 
4.09 % 


4.^8 
4.23 
4.36 


- 




Basic FEEP Outcomes 
by students 
by instructors 
by cooperating 
teachers 


4. 17 
4.24 
4.28- 


- m 


- 




Correlation (Range of item 
relat"flbri to every other 
i tem) / 


r .. 


r 




\ 


Basic Comrafuni cation Skills 
General Reaching Skills 
Basic Fl3tP Outcomes 


.58-. 77 
.46-. 71 ■ 
.51-. 71 * 


.17-. 69 
.24-. 76 


1 

' 11 


o 

ERJC 


/ 


73 

1 1 


) 



I 



Internal Consistency alpha 

Basic Communication Skills .85 

General Teaching Skills .89 

Basic FEEP Outcomes .91 



alpha 

,87 
.86' 



alpha / 
.51 
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VI. "What They Bring With Them" - Formative Dimensions of the 
. ' Student Information System 

\ Peter Lemish 

Gradual Research Associate ~ 
College of Education 
* The Ohio State University 4 

This presentation will describe a study of a set of teacher education 
students using qualitative data techniques appropriate to Component III 
(Narrative data) of the OSU Student Information System. The purpose of this 
study was to gain an understanding of the qualitative forms of teacher candi- 
date data available^ the entry level of professional preparation. It is 
based on the fundamental assumption that our teacher education programs should 
direct attention to and be affected by the knowledge, skills, attitudes, per- 
ceptions, and general backgrounds that students bring with them at the begin- 
ning of, as well as throughout, their professibnal studies. The ways in which 
students experience the teacher preparation program, in light of their own 
background and experience, represents the formative dimension of the SIS 
documentation and assessment process. 
Research Methodol ogy ■> 

Naturalistic inquiry was applied in this study. Onjy one intervention, 
in the form of a written exercise, was introduced. The course selected for 
this inquiry was the first of a two quarter sequence kfiown as the Professional 
Introduction to Education. This course, is the first course taken by the 
teacher candidates in their professional studies. . This course was selected 
because it enabl<?d study of how the initial stages of the teacher education 
program relate to the background of the teacher candidates. Fyrther, the 



* This study was conducted as part of the author's more extensive inquiry into 
the nature of social processes and experiences in classroom settings. 
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course curricCilum stated that a primary function of this introductory profes- 
sional sequence was to enable teacher candidates to explore, develop, and ' 
relate their own personal" and professional ^rtfelopment to educational theories 
and methodologies. Aside from knowledge and skill learning^ in the latter 
domains, the major outcome expected through this personalization was the 
identification and development by the teacher candidates of their own peda- 
gogical style. While the curriculum delineated in rather explicit fashion the • 
educational and psychological theories as well as the pedagogical methodol- 
ogies to be inc\uded in the course, few guidelines or directives were provided 
to assist instructors to personalize the course to the teacher candidates or ■ 
to relate to the backgrounds they brought with them. As a result, each 
instructor had the latitude to facilitate this emphasis in /the course. My 
familiarity with the staff suggests thaft the instruc^r chosen for this study 
was one of the most active in addressing both the personal ization of the 
course and the personal and professional development of her students. 

On the first day of class, I explained to the 19 teacher candidates that 
I would be functioning as a participant-observer in all class sessions. I 
explained that the purpose of thi^study was to tell the story of the class 
from the students 1 viewpoints. Therefore additional data-gathering measures 
would be employed such as interviewing, audio- and video-taping, and 
photocopying of all written materials. Participants were guaranteed, anonymity 
and all signed human subjects release forms. 

Four methods of da£a-gathering produced the following research materials: 
1) Participant-observation .by the researcher in 90% of the class sessions 
prpduced extensive field notes. *\ 
• 2) Taping of class sessions resulted in audio tapes of all class session^ 
(approximately 60 hours) and video tapes of all Thursday class 
sessions (20 hours). 

2 
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3) * Sewi-structured interviews with students were conducted by the 

instructor and the researcher at the beginning of the quarter; the 
instructor at Jthe end of the quarter; and the researcher at the end 
of the quarter. In addition, the instructor and the researcher met. 
on an average of two hours per week to discuss class sessions. All 
interviews and discussions with the instructor wsre audiotaped. 

4) Unobtrusive measures included collection and photocopying of nearly 
all written materials generated by the teacher candidates and the 
instructor. "These materials constituted the primary, though an 
indirect, source of data about the backgrounds of teacher candidates 
and included assignments such as summaries of chapter readings, 
reports on weekly field observations, midterm and final projects, 
weekly course reaction papers, summaries of clinical experiences, \ 

. statements-of personal and professional development during the t 
quarter, and final instructor-course evaluations. 
Data analysis was begun with a thorough examination of all materials 
collected. As natural, categories emerged, data related to the formative 
dimensions of the teacher candidates were transcribed for each participant. 
The categories which emerged included personal background and career thoughts; 
views of teaching, teachers, education, and the educating process; critical 
educational experiences and influences; and s«l f-description analysis as 
learners, as teachers, and as persons. Summaries of each teacher candidate 
were written and the findings of this study were developed through analysis of 
patterns found in these, summary statements. A similar procedure was applied 
to the analysis of processes employed by the program and course instructor to 
relate to the backgrounds of the course participants. 
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• Findings ^ 

The following section summarizes findings about the formal and informal 
processes used in the class studies, the findings relating to the backgrounds 
brought by the teacher candidates to their professional studies, and findings 
abdut the interaction cff Students to the course experience. 

Findings on the formal processes . No background data on teacher candidates, 
such as is collected in admissions procedures, was distributed to the instructor. 
No pretesting or inquiries into students' knowledge of content to be presented 
or their capabi Hty Mevel in the pedagogical skills to be practiced, in the 
course were undertaken or required. One assignment was directed specifically 
at eliciting information about the teacher candidates 1 backgrounds. In an 
initial "Letter to the Instructor," students were asked to provide basic 
demographic information (i . e. , name, age, marital status, major and work 
experience) as-well as short statements about themselves describing Strengths 
and weaknesses, something they would like the instructor to know about them, 
and the factors which influenced their selection of education as a major/career. 
As part oftheir final evaluation, students wrote about their personal and v m I 

• professional development dwciog the course. No request was made in this 
assignment to relate development during the quarter with the background which 
The students brought with them to this coures. In class activities and 
assignments, students were encouraged to personalize and to provide their own 
personal reactions to the readings; teachers, students, and schools observed 
in the field settings; clinical experiences; and events in their own class. 
No information about students was requested or transmitted to the program 
office, ne*t instructor, or the students' files at the end of the course 
except the grade. 
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Findings on the informal processes . In her informal discussions with the 

* • 

students (e.g., before and after class or during a break), the instructor 
often related to or probed for information ^about the teacher candidates 1 
background and present activities. Aside from developing a friendly 
relationship with, each of the students, this technique enabled the instructor 
to add to her knowledge of each teacher candidate. Based upon her knowledge 
of each of the participants 1 backgrounds, the instructor <Jh several occasions 
did suggest readings or meetings with teachers in the field with similar 
educational interests. She also demonstrated a broad knowledge and 
understanding of the backgrounds that the teacher candidates had brought with 
theffl, as well as extensive knowledge about the students' development during 
the quarter and their current status both personally and professionally. 

Findings on the backgrounds of teacher candidates . Each teacher, candidate ' 
brought a rich and extensive background to his/her professional studies.- The 
following is a summarized synopsis of this background/ 

1) Knowledge - Teacher candidates possessed a rather extensive, though 
general, stock of knowledge about life in educational settings which 
they were able to 'relate to many topics ^discussed in the class. /V 
Students used this knowledge, for example, to extend a point made by 
an author/colleague to teaching situations or to explain how a - 
particular opinion they had was reliant to educational practice. 

2) Skills - Well over a majorit\^f the students had experience ^using 
some of the pedagogical ski^s designated for practice in this 
course (e.g., developing and coordinating activities; working with 
groups or individuals; human relations skills). Because of these < 
experiences, many students were able to identify skill areas which 
they were interested in improving or exploring. 

3) Attitudes*, Opinions, and Commitments - Throughout the course, 
participants stated freely their attitudes, opinions, and commitments 
about such varied educational topics as the role of the teacher, 

. open versus traditional schools, types of appropriate discipline, 
suitable environmental arrangements in classrooms, and^effecti ve 
teaching strategies. Furthermore these students were able to defend 
.their opinions with reasoned arguments based upon knowledge and 
appropriate examples from field observations or from their own 
previous experiences. 



so 



4) Values - Through, advancement of their attitudes, opinions, and 
commitments, teacher candidates were seen to have expressed value 
positions regarding educational and career topics. Among the 19 
students, a very wide range x of value combitments was present. 

* 

5) Interests - Though expressed in general terms, these teacher 
candidates indicated that they have thought 4 . about why they wanted 
to be teachers, the age group and content area^ they preferred, 
th§ level of social status afid financial reimbursement irffotved in 
teaching careers, and what they must do to become/be effective 
teachers. . 

6) Views of Self ^s Teacher and as Learner - Students were able to 
discuss their strengths apd weaknesses as learners as well as the 
instructional strategies that worked most effectively with them. 
Similarly, they applied their self-understanding to project/reflect 
upon how they might did function as teachers, their possible 

_ strengths and weaknesse's , and areas in their professional development 
which they were interested in improving. 

7) Personal Background - Aside from data that can be delated to the 
teacher candidates,' professional background, participants shared 
many aspects Of their personal lives and backgrounds. Thus, much of 
the personal dynamics, character-personal ity» life-style and world 
view £hat the students had been developing throughout their 1 ifetime 
were shared and came to be understood by the other participants. 
'Similarly, interests and activities^ outside of th$ two hours a* day 
that they spent in class became part of our understanding of one 
another. * - * ' 

The three main sources of the teSacher candidates' extensive professional 

background were a) their 12 years plus experience as participants in both 

\ * 
formal and informal educational settings; b) previous studies; c) critical 

educational experiences. In short, these teacher candidates were not strangers 

to educational settings and few things that happened there seemed to surprise 

them. Furthermore they activated their experience^ and background when 

explaining, for example, why they interpreted a teacher or students' actions 

in a particular manner or in discussing the characteristics of good 

poor teaching. Finally, the background of each teacher candidate was 

idiosyncratic and very personal. Further, there was a great amount of variance 

between individuals in most every 'dimension of their backgrounds. 
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Most of the information elicited seemed to. exist at the implicit, 
preconscious level. Though most of the students' backgrounds emerged indirectly 
and slowly throughout the 'quarter,, the teacher candidates willingly introduced 
and discussed this information. Further, the students themselves were not 
able to elucidate in a complete or holistic manner their own personal . and 
professional backgrounds. It should be noted that the knowledge, skills, and 
views expressed were very general and it did not appear that most students had 
reflected upon or even attached importance to this information* In short, 1 
this background appeared ~to be simply Jtaken for granted. 

In their writing of personal reactions, the teacher candidates admitted 
to themselves the presence. of gaps', specific interests, needs, and weaknesses 
in th^ir present development , personally and professionally. While requests 
for elaboration may have indicated those areas that the students felt were 
strorig or reasong for th$, gaps, weaknesses, etc. , these admissions in and of 
' themselves are indications, at least implicitly, of a basic recognition of the 
background which they brought with them to # their professional studies. 

Findings about course* impact .. Students indicated that a major factor jn 

* 4 * - 

their willingness to share information about themselves or their openness in 
expressing their* opinions was the supportive environment created and facili- 
tated by the instructor. The emphasis upon personalization of the course and 
the opportunity to explain Iheir'pers.onal reactions created opportunities for ' 

students td relate their backgrounds to their initial professional studies. 
* 

Development or extension of the teacher candidate's backgrounds occurred qs a 

' result of individual efforts j#4,he students in the 'course. For example, 

several students, noted that in writing summaries qf field observations they 

strengthened their commitment to *acti vity-ornented't^hi ng strategies, over 
• ... • ■ ^ - ' 

lecture style approaches, after seeing the impact these approaches had on 

, • V:; '-* ' ' r < • v - v ' ' ■ 

students observed. • . • . . ■ 
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Conclusions 

There appears to be a major disVocation in the relationship between the 
teacher candidates and the teacher education program^ The findings demon- 
strate that teacher candidates brought with them to their professional studies 
r.ich and extensive backgrounds. These backgrounds include, at various levels 
for individual students, knowledge about educational practices, capabilities 
in some pedagogical- skills, as well as definite attitudes, opinions', and. 
commitments about many aspects o'f the educating process- -Yet, in terms of the 
formal program, these backgrounds were not addressed or related to in a sig- 
nificant manner. To the degree that stie was able, the instructor attempted to 
personalize the course by sanctioning the sharing of personal reactions. 
While not directed specifically at developing the backgrounds teacher candi- 
dates brought with them, these efforts do indicate an attempt to relate to 
these students in an individual manner. 

One major outcome of this dislocation is that/at the formal program . v 
level , the teacher edotration program related to'the teacher candidates as if 
they began their professional studies "tabula rosa. 1 ' The findings in this 
study clearly demonstrate that this is opt the case. The r backgrounds that the 
teacher candidates brought with them were raw in professional terms, highly 
idiosyncratic, and limited by dependence upon personal experience. Nonetheless, 
this background servld a critical roleias the 'organizational framework witliin 
which experiences and knowledge from their initiaT professional studies were 
fit. In my experience,, teacher candidates and /instructors -who rare aidpd in 
documenting and analyzing ttfis background arVable to proceed to a broader and 
often challenging consideration of educationaJ-^te^and practices./ • 

A second ia^ortant outcome of this study is that. data about tfoe background 
dimensions of teacher candidates is elicitable and documentable. In the open 



and supportive environment facilitated by the course instructor, the students 
studied demonstrated that they were 'willing to store information about J" 
themselves. Thus, given the opportunity to share and to explain their 

personal -professional reactions, these students drew , actively upon and 

- .... ^ 

exhibited the backgrounds they brought with them. This indirect approach' 
applied by the instructor could be a useful strategy for eliciting in a 
deliberate manner information that may be unobtainable using mor/"direct 
approaches (n.b., given its implicit, taken-for-granted status, students may 
not be able to^fully elaborate this background when responding to a direct 
request). This conclusion suggests that careful consideration should be 
directed at the processes applied in eliciting and relating to the backgrounds 
that teacher candidates bring with them. 

Finally, though the instructor developed during the quarter an extensive 
'understanding of each teacher candidate, this information will not be available 
to future instructors. More importantly, the students themselves* are unaware 
of the richness of knowledge and skills that tTiey bring with them to their 
professional studies. As a result, the "tabula rosa" dislocation will be 
likely to continue cyclically with each new course and quarter. On the other , 
hand, in the final instructor-researcher interview, the instructor was able to 
summarize rather succinctly the background, professional states, and issues- 
topics of concern for each teaqher candidate. It would seem that the instructor 
might just as easily have transmitted this information in some fashioryfor use 
by future instructors as well as by the teacher candidate. This is the role 
that may be played by Component III of MS. • 
. Implications - 

One obvious 'impl icatiffn from this study is as follows: if programs 
directed attention to and relatedto the backgrounds brought by teacher 



candidates to their professional studies , *they would most likely need to * 
consider changes in their present 'configiiiati on and activities. Such changes 
would correct the present dislocation in the teacher candidate-program 

k 

relationship. One expected result of such changes should be more effective 
facilitation of instruction and learning. A major role of SIS should be to 
make this background information available to programs, instructors, .and 
teacher candidates. • " * 

Second, in terms. of the design and use of SIS, this study suggests that 
without Component III - Narrative Data, Components I and II provide a limited, 
perhaps illusionary, view, of the development of the teacher candidate. The 
qualitative information to be included as narrative data in Component III is 
likely to provide the necessary grourjding and perspective needed for under- 
standing the descriptive and statistical data of Components I and II. While 
generalizations or statistical analyses might be able to be made on very 
specific aspects of the teacher candidates' backgrounds, comparisons or general 
statements about the backgrouptds , as a whole, would likely be- too general to 
b* of value. For example, comparisons oft. career thoughts,* such as desire to 
be an elementary. teacher because a teacher candidate likes working with young 
children, would have to be understood in relation to a holistic view of each 
teacher candidate 1 s background. 

Therefore, it would be useful to develop a basic set of guidelines to be 

* ! ■ • 

used by instructors in transmitting data for inclusion in Component III of 
SIS, Such guidelines should outline broad categories related to the personal 
and professional development of teacher candidates. Jhe categories provided 
in the findings section of this study could be used 'as ah initial basis for 
developing such guidelines. yAs well, attention of designers should be directed 
to instructional processfcss>and approaches/to be used in eliciting these data. 
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VII. Peering into the Future of the Student Information System 

William E. Loadman . * ■ 

Coordinator, Measurement and Evaluation Services 
College of Education 
The Ohio State University - , 

As one re-examijies the four basic purposes of the SIS system and the 
projected data matrix the enormity of the implementation task becomes readily . 
apparent. Substantia*! progress has been made but the installation and func- 
tioning of the entire system is far from complete. Substantial amounts of 
energies need tp be allocated to the interpersonal as well as to the methodo- 
logical and administrative dimelnsi ons . As we move through the. implementation 
we are discovering that some aspects of the basic purposes may not be completely 
compatible with each other and may under certain circumstances be conflicting. 
Therefore our primary strategy for implementation will remain the basic one 
step at a time approach, building in small and successful modifications to 
the purposes and procedures in the system as these become apparent. 

To date the* system has received excellent support from all levels within 
the college (including fifscal, orgam' zati onal and programmatic and collea^geal ) . 
We are diligently working from our end to secure the continued support neces- 
sary for success. All indications are that this support will be continued. 
However, the ominous cloud of fiscal retrenchment facing higher* educati on in 
general and the state of Ohio and the College of Education at The, Ohio State < 
University in particular, is ever present. At this time and projected into 
the short term our operation hal not been significantly constrained^. and will 
not be so constrained because qf the integration of these "efforts into the 
total operation of the college's functioning. Conceptually the long term 
projections are very positive, but only time will, tell what will occur 




operationally. . As resource? continue to shrink, the competition and. pressure „ 
for allocation of internal resources will continue to grow. This, fact, coupled 



with declining enrollments creates circumstances which,makes predicting w|tK 

> — , — \ 
any degree of certainty very perilous. Our position is not walike any otherV 



activity currently occurring in colleges of education around the country. 
Our challenge is to continue te produce "in the face of adversity and become an 
''indispensable and well integrated element in the functioning of the college. 
Our resources, while not extensive or to the level we would desire are adequate. 
We can continue to move the system forward with our current level of allocation. 
Howevefr, to get the system completely, operational will require an increased 
level of support. . 



It might be well to identify a number of speci fic* actions which have been ' 

planned for the near future. The data matrix has several cells in the descrip- 

l - t - 

. tive and/br assessment column where there ere logical data entries.- We/will 
/ . 

begin to systematically move beyond the sophomore- level data (PI) and into 

*" * ■ • 

special methods courses, foundation courses, and ultimately into student-teach- 
ing. Each of these effects -will require additional instrumentation, content ^ 
area input, and feedback loop mechanisms.' While this may be* time consuming 
and somewhat slow* -it is the only reasonable way to proceed. A second area 
of involvement will likely come fr^m an extension of current -follow-up efforts. 
A follow-up of students from graduate programs ^nll be introduced this year as 
Well «s seeking responses from current employers of our recent graduates re- 
garding their capabilities. 

Existing instruments will continue to Jbe refined and tested for quality^ 
The quality of all new - instruments will need to be ascertained and where they 
are found to be at an unacceptable l'evel the instrument will need to Xe revised 
accordingly. With each step forward on the implementation process it-will be 



necessary to devise an appropriate and reasonable feedback loop for use of data. 



This crucial and time consuming process will need to be in place at each level 
of the system before we can moye the system forward. 

We have only begun to scratch the surface on the data potential listed in 
the narrative section of tha matrix. . This rich data source will continue to 
receive limited attention unless additional resources can be obtained, Imple- 
mentation of thi? aspect of the s y ys tern is likely to proceed very, slowly. 

Additional research efforts are currently underway utilizing existing 
information in the data bank. Two studies, one involving infprmation pn the 
National Teachers Exam (NTE) and another examining the relationship between 
characteristics of entering freshmen and whether or not they stay in teaching 
are currently underway. Additional research needs to be initiated in this area 
and we will be attempting to stimulate such research. Efforts are currently 
underway to pursue external funding to pursue these and other efforts. 

An area that is critical to the ultimate success of the student information 

system is the information storage and retrieval capabilities of the system. 

The computer system is currently in its infancy and unless the- system matures 

rapidly, the "parents in the neighborhood" may not let thd Infant grow to 

; 9 

maturity. A lon£ term and short term strategy has be*n developed to help get 
the system developed. The long ^te^m-strategy is designed to create 0 and uti- 
lize a self contained mini computer to sttfrf, retrieve, a^yze and produce 
reports from data collected through SIS in a very flexible fashion. The 
short tem strategy is to collept the data and crudely store it while the long 
term programs are being developed. In the short term, all data analyses, mani- 
pulation and reporting will be done via other mechanisms (e.g. , batch processing 
on a large main frame computer). •This mechanism, while not highly efficient, 
is functional . * 

By far the largest concern for the system lies 'in the area^of utilization 
of information. The data generated by. and through the system needs to* be , 



provided in a timely, appropriate and useable fashion. The information also 
needs to be used in consistent and appropriate fashion by decision makers 
within |he college. As the* system* is relati^ly^w it is difficult to deter- 
mine the extent of current utilization. However, there are a few positive 
indications of use of information generated through the systems. We will be. 
spending considerable energies in this area in* the next year for this, more 

than any thing. else, will signal -the degree of success in implementing the 

v . • " ■ • 
system. Utilization* is Clearly linked to the administrative elements, the 

interpersonal .elements, an<fcthe methodological elements. * 

As discussed in an earlier paper, the interpersonal aspects of implementing 

an, evaluation system need to 6e carefully and consistently addressed. Therefore 

another major block ¥f time will be allocated to interacting with different : 

levels of key actors in a wide variety of contexts. This time consuming evFort 

will be sustained , and perhaps; increased, because .without this effort the prroa- 

bility of success is limited. * 

* •.. 

It would seem that after the discussion of specifics, a return to the more 
general status may be appropriate. As one reflectson the four basic purposes 
of the system, namely:. - 

r. ; to collect data about our students and programs for use in the 
evaluation 9f both graduates and programs; - 

/2. '-to provide data for use in student advising, counseling, and 
; remediation; , '" • 

3. to provide a data source for research on the nature and the 3 
development of;teacher education students and programs as well 
as other professional education personnel programs; 

u to document student experiences for accountability and 

accreditation purposes*. . . ■ , r 

'Of the initial four purposes , none; have been completely met. Numbers 

one and four have met with some success as we have moved forward with imple- •* 

mentation. However, success in each of these can only be determined after more 

of thesystem has been put in place. 'With- respect £o purpose number thre*, , 



the seeds of research are beginning to germinate and sprouts of research 
activity are beginning to bud. It^js far too early to see the products of 
any research efforts. Finally, progress on„ purpose number two has been quite 
limited. Given the current resources and the present direction of the system, 

» - - 

progress in this area will continue to move at a snail's pace. The reader 
should not interpret this status picture. of the purposes as negative. Rather 
it should be interpreted as hopeful and positive. Good progress is being made 
and positive things are happening. It is early in the life of this system and 
we are excited about its future. iSith, continued attention and support the SIS 
will be a highly functional and successful element-i'ntegrated into the regular 
operations of the College of Education. Only. time will tell if we have the 
energy, capability and leadership necessary to make these ideas into reality. 
We will continue to move forward, one step at a time'. Our implementation 
process will be planned and deliberate. We realize that ^his process will 
take time, but if current status is any indication of future success, then 
our future will be quite .successful . 
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FRESHMAN EARLY EXPERIENCING PROGRAM 
THE OHIO STATE UNIVERSITY 

EXPLORATION PROFILE 



Autumn, 1982 



Instructions for use: 

This form ts Intended to point out strengths 
and needs of potential teacher candidates 1n h 
order that they can plan for further develop- 
ment 1n later professional courses and 
experiences. 

Cownents will be useful to students and Instructors, 
but will not be -accommodated on the computer sheets. 



A. Basic FEEP Outcomes : The Student : - 

1. Exhibited exploratory behavior directed toward discovering 
a wide variety of teacher roles and responsibilities, I.e., 
sought out and took advantage of opportunities. - 



Qtr/Yr- 
Student's Name 
Signature 



Blue 

Yellow 

White 



(person completing .form), 

Cooperating Teacher 

FEEP Instructor/Seminar Leader 

FEEP Student * 



Comment: 



Participated in a variety of teacher roles and 
responsibilities; followed through on opportunities. 



Comment : 



Itdms 3-16 should be /assessed relative to the level expected of 
a first year teacher education exploration stutient. 



if* 

if* 

I/if 



t 



o * " 



£3 



, sis 





Displayed initiative in completing tasks once a responsi- 
bility had Ween accepted, i.e., independent, responsible. 

) * 
Comment: ^ ■ ' * ; 

Displayed initiative in Joking on routine tasks, i.e., tasks 
did not have to be pointed out; had no need to remind. . 



Comment: 



5. 



Organized tasks in order to ensure completion of all responsi- 
bilities, i.e., divided and ordered tasks; , prioritized 
responsibilities. 



Comment : 



Exhibited professional behaviors, I.e.. was punctual, respon- 
sible; observed confidentiality; used appropriate language. 



Comment: 



Appearance was appropriate to the setting, I.e., was healthy, 
clean, neat. 

Comment: ' . \ 1 
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B. Basic Communication Skills : The Student: 

8. Exhibited basic reading skills, I.e., 
accurate, appropriate to Jetting. 



was\ fluent, 



Comment: ' 

Exhibited effective writing skills, i.e., was logical, 
clear, appropriate to setting. 



Comment : 



10. Demonstrated expressive speaking ability , i.e., was audible, 
appropriate to setting, appropriate pace. 



Comment:* 



C. General teaching Skills : ^ The Student: 



IX. Exhibited clarity, i.e., ideas, thoughts, and activities ( 
were expressed in ways that were clearly understood by pupils. 



Comment: 



12. Exhibited enthusiasm, 1.6., delayed personal commitment 
to course content and excitement about teaching. 



Comment: 



13, Established effective profession, interpersonal relation.- 
ships* i.e., interacted openly, developed rapport with 
both teachers and pupils. 



Comment: 



* 14. Evaluated own performance and responded to advice, i.e., 
made objective and rational criticism of own, performance 
and used advice to modify behavior. 



Comment : 



15. Is able to describe differences among students' character- 
istics and needs and to explain reasons for individual 
student's behavior. 



Comment: 



iL Is able to describe several ways in which two or more 
Xteachirs' styles are alike and different, i.e., directive 
-*vs. ndn-di recti ve, view of learners, preferred ^strategies,* 
9 preferred mode's of control . r 



Comment : 



Setting 

17 



Did extenuating circumstanced exist which Influenced the 
student to perform at a lower level than would otherwise > 
havirbeen likely? 



^ Comment: 



5* 



ft 



i& Si 



-v 



J 'J 



"j? 



// 




n 



'V 



h 



-aw- 



V 1 




-3- 



Overall Performance ' 

18/ltelatlye to the live! expected of an Individual whom 
you would recbwnenll with no reservations to continue 
' in teacher education, the student 1 s overall performance 
1n this field experience. 



Comment: 



/ 

jo £S 



V tor 
<Jj -a 



1i <Zi 



F. Suggestions for GrowtH 



s 



1 
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Pro fess lonal Introductio n 
Teacher Candidate ProfTP 



•n A 



Spring, 1982 
* 



Instructions' fo> use: - , . 

* it 

This form Is intended to be in overall •PPrjIsiJ of 
the teacher candidate's attitudes ind abilities re- 
lated to teaching as observed during the PI teaching 
experience. s \ 

The Guiding 'Remarks are Intended to supply further 
Interpretative Information relating to each criterion 
appraisal. ( ■. 

The Comments spice (s for recording details- which 
help specify i problem area. Tou ire encouraged to 
make i comment for ill low ratings. 



A. BASIC SKILLS 



SSN 
TC 



Qtr/Tr 



School/Field Placement 

CT , 



"Blue - Cooperating Teacher (CT.) 
Yellow - PI Instructor (IN) 
♦White - Teacher Candidate (TC) 



\. TC displayed basic reading skills required for a potential 
teacher. 

- Oral reading to class was: 

1 2 3 * , J^-t outstanding 
Q Q □ □ □ 

Comment: \ ___ \ 

- Analysis and comprehension % of reading was: 

• 1 2 3 w 4 , — L, outstanding 



Guiding Remarks 



Fluent and expressive 



Verbal demonstration jpf 
accuracy of understanding 
of what 1s read. 



Comment: 



2. TC displayed basic writing ski Us required for a potential 
teacher. 

- Written expression skills were: 

' 1 2 3 , * -A. outstanding 

□□>□□□ 



Comment: 1 

- Handwriting skills were: 

1 2 3 

inadequate 



□ an d □ 



outstanding 



Comment: 



3. TC displayed speaking skills required for a potential teacher. 
- Diction was: 

I ^ 2 3 JL J2- outstanding 



Comment: 



- Audibility was: 



Inade^ta Q Q fj Q- Q 



outstanding 



Includes all student 
prepared handouts and 
other public writing 



Public writings on 
blackboard, handouts, 
pupil's work. 



Comment : — 

. Expressiveness was: 

1 2 



inadequate Q Q Q Q Q 



outstanding 



Manner of expression 1n 
words. 



Loud ^enough to be heard 
by al] of class. 



L Use of varying pitch 
and intensity of ex- 
pression. 



Comment: 



\ 
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GENERAL SKILLS 
4. Clarity: 
Inadequate 



QQ □.□ □ 



i 2 



Comment: 



%( Enthusiasm: 
Inadequate 



Coootnt: 



6. „ Time management 
. ' Inadequate 



□ □ □ □ □ 



Connent: 



7. TC personal Interaction skills: 

u. u^ fa □ □ □ □ 

Comment: ■ 



TC 1s self critical and responds to advice: 

IM &,« _ □ □ □ □ □ 

Comment: 



TC planning skills were: 

* 1 2 3, 4 3 

Inadequate j— j, j— j j— j Qj 



Connent: 



10. TC work adjustment wa$: 

12 3 > 5 

Inadequate 



Comment: 



outstanding 



outstanding 



outstanding 



outstanding 



outstanding 



outstanding 



Ideas, feelings, 
thoughts and activities 
expressed <1n a way that 
was clearly understood 
by pupils. < . 

Displayed personal 
commitment to course 
content and excitement 
about teaching. 



Management of student 
time to promote high 
quality, on- task student 
behavior. 



Ability to Interact 
productively with both 
teachers and pupils. 



Does (he student make * 
objective and rational 
criticism of own teaching 
and modifies teaching 
behavior following 
advice. * 



Ability to plan lessons 
which demonstrate both 
detail and logic In 
content and organization. 



outstanding 
T 



OVERALL JUDGMENTS 

11. In terras of teaching difficulty the setting was: 
I 2/3 4 5 

very 
difficult 



□ .a □ □ □ 



very 
easy 



Comment: v * 

12. The overall teaching performance for the TC ^in this 
unit was: 

1 2*3 4*5 

inadequate 



□ □ □ □ U.J 



ou 



tstandjng > 



Comment: 



v 



Student was punctual, 
completed assignments 
cirefully and correctly 
and behaved and dressed 
appropriate to the norms 
of^he school. 



Hake a judgment on 
difficulty to teach* 
the class as It relates 
to pupils- their behavior; 
their attitude to learn- 
ing; size of class; 
ab1 1 1 ty range . 1 

A rating of '2* would 
be considered to be 
•at risk*. ■ 
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. ' . . ■ I Spring* 1982" 

• • i 
.. ■ , .' The/Critical Event 1n PI , , 

> .» • ~ ■ ' ' * - 

Remember last yea/1n,FEEP you completed experience report forms 
(ERF's) frequently throughoi/t yoifr program? Well the ERF'S were a type 
of critical Incident record. The use of the. CI technique in PI has some, 
similarities and some differences to the ERT's you used 1n ? FEEP. - 

Explanation , ' • t » 

„ ' A Critical Event 'is an incident that has special meaning to. you. More 
specifically it refers to- your involvement in and reaction to a professional 
activity Which had'a significant impact upon you. Such events will evoke 
feelings and thoughts and often- 1 earnings and/or. insights. Through such 
incidents we begin to see burselveS as persons and as educatprs* in a. dif- 
ferent Spiy . . • " 

As examples of Critical Events, consider the" fql lowing:* 

- in your first peer teaching activity you felt successful « 
because you discovered that you can communicate and help 

persons^ learn something new. .--»". 

- an exchange with a group of eighth" graders made you fear- 
ful about your ability to deal with peer pressures and 
adolescent group activityt . , 

- a class discussion has made you reconsider your opViion 
regarding the importance of basic skills in education > 

* * * 

• Understanding the Critical Events which take place during the education 
.of- teachers is especially important to us and also valuable for you in de- 
veloping' greater understanding.^ your personal .and teaching roles,. 



Each week during PI we would like you to complete a Critical Event 
Form. Keep the. forms yourself and at the end of the te>m select the most 
significant event and give your instructor a copy. This one Critical Event 
Form will then be filed with SIS. ' 
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P. I. CRITICAL EVENT FORM ' 


> ■ 




• • '■';'(.■• : 


Name: . 


■ ^ 






- V 


Social Security #1 






< • • 


. ■ . ■ 


« *« * 

. Date: 








» 


r I ace une event riappenea: 


• 

* 


< 




» • ■ 

People wtio-were involved: • V ■ 

■ * r ! 

Date and Event: ; \ 


i 


• '.; 

; i - 


V 

•4 . ^ 

c 


What Happened (keep.it sfiort): - 






( 


/ > 




r" 




- t 
/ 


Why is tbis Event v so important^^you? (Try to .identify 
; here/like, "I wa$ the proudest I've ever been";; 11 ! was 

t 


an emotion or feeling . * 
scared to death 11 . ) 

• > 


• 


; , ±* 

/ 


1 




t 

t 


* f * 

• Please keep a copy yourself and give a copy to your P.I. 


instructor 
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